-- Logs begin at Thu 2022-03-24 14:12:15 UTC, end at Thu 2022-03-24 15:10:17 UTC. -- Mar 24 14:38:48.004386 dv-cinder-834805-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 24 14:38:48.011905 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 24 14:38:48.013941 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 24 14:38:48 2022] *** Mar 24 14:38:48.013941 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 24 14:38:48.013941 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 24 14:38:48.013941 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: nodename: dv-cinder-834805-2-iscsi Mar 24 14:38:48.013941 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: machine: x86_64 Mar 24 14:38:48.013941 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: clock source: unix Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: pcre jit disabled Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: detected number of CPU cores: 4 Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: current working directory: / Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: detected binary path: /usr/bin/uwsgi-core Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: your processes number limit is 47680 Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: your memory page size is 4096 bytes Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: detected max file descriptor number: 2048 Mar 24 14:38:48.014318 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: lock engine: pthread robust mutexes Mar 24 14:38:48.022835 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: thunder lock: enabled Mar 24 14:38:48.022835 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 24 14:38:48.022835 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 24 14:38:48.062812 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: Python main interpreter initialized at 0x5637ae1439c0 Mar 24 14:38:48.062812 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: python threads support enabled Mar 24 14:38:48.062812 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: your server socket listen backlog is limited to 100 connections Mar 24 14:38:48.062812 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: your mercy for graceful operations on workers is 90 seconds Mar 24 14:38:48.063171 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: mapped 403077 bytes (393 KB) for 2 cores Mar 24 14:38:48.063233 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: *** Operational MODE: preforking *** Mar 24 14:38:48.063515 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: *** uWSGI is running in multiple interpreter mode *** Mar 24 14:38:48.063515 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: spawned uWSGI master process (pid: 86167) Mar 24 14:38:48.063741 dv-cinder-834805-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 24 14:38:48.064267 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: spawned uWSGI worker 1 (pid: 86181, cores: 1) Mar 24 14:38:48.064607 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: spawned uWSGI worker 2 (pid: 86182, cores: 1) Mar 24 14:38:48.064763 dv-cinder-834805-2-iscsi devstack@keystone.service[86167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 24 14:38:53.765664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 14:38:53.765664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: from cryptography.utils import int_from_bytes Mar 24 14:38:53.766532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 14:38:53.766532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: from cryptography.utils import int_from_bytes Mar 24 14:38:53.769895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 14:38:53.769895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: from cryptography.utils import int_from_bytes Mar 24 14:38:53.770522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 24 14:38:53.770522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: from cryptography.utils import int_from_bytes Mar 24 14:38:53.811054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 24 14:38:53.811247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 24 14:38:53.811435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] command line args: [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 24 14:38:53.811667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 24 14:38:53.811854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ================================================================================ {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 24 14:38:53.812093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] admin_token = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.812314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] config_dir = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.812479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.812695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] config_source = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.812898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] debug = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.813047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] list_limit = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] log_config_append = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] log_dir = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] log_file = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.815831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.816046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.816389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.816597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.816793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.816977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.817158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.817339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.817516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.817745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.817981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.818292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.818799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.819050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] publish_errors = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.819255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 24 14:38:53.819452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.819618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 24 14:38:53.819807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.819989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] command line args: [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 24 14:38:53.820172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.820388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 24 14:38:53.820546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.820724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ================================================================================ {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 24 14:38:53.820903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.821099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] admin_token = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.821260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] standard_threads = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.821426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] config_dir = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.821554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.821717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.821842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.821999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] config_source = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.822157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.822298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] debug = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.822422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] use_journal = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.822550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.822752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] use_json = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.822752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] use_stderr = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.823005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.823127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] use_syslog = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.823250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.823371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.823508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.823647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.823779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.823903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.824051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] list_limit = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.824178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.824308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] log_config_append = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.824308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.824568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.824697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] log_dir = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.824819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.824947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] log_file = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.825070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.825197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.825329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.825458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.825580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.825775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.825907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.826037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.826037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.826316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.826441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.826572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.826733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.826897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.827027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.827151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.827280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.827403 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.827537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.827667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.827795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.828041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.828208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.828347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.828476 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.828598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.828726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.828851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.828973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.829104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.829104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.829348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.829472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.829606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] publish_errors = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.829730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.830207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.830338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.830467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.830591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.830785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.830917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.831046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.831169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.831291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.831412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.831545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] standard_threads = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.831669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.831791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.831924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.832125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.832125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.832374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.832512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] use_journal = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.832647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.832771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] use_json = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.832899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.833022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] use_stderr = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.833022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] use_syslog = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.833263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.833385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 24 14:38:53.833512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.833643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.833785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.833919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.834989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.835997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.836119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.836248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.836372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.836372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.836608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.836730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.836853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.837953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838863 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.838996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.839124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.839254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.839254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.839499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.839622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.839744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.839865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.840033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.840167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.840291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.840412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.840540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.840662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.841895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.842131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.842293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.842476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.842658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.842837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.843059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.843217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.843397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.843578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.843758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.843936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.844123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.844324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.844578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.844744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.844933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.845115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.845305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.845487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.845668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.845847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.846027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.846264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.846456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.846611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.846766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.846904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.847060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.847189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.847360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.847496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.847661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.847793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.847918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.848961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.849091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.849222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.849346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.849498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.849622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.849746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.849876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.850905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.851906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.852067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.852239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.852367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.852489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.852613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.852808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.852935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.853066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.853190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.853320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.853455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.853578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.853709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.853878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.854008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.854173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.854300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.854424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] auth.external = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.854594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.854752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.854987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.855133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.855264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.855394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.855524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.855656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] auth.password = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.855788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.855925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] auth.token = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.856935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.857945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] credential.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.858973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.859096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.859219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.859348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.859471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.859612 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.859762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.859897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.860905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.861035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.861160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.861293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.861531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.861676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.861803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.861935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.862070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.867314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.867510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.867661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.867797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.867927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868842 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.868967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] auth.external = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.869990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.870229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] auth.password = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.870364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.870489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] auth.token = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.870613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.870749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.870875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.870999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.871123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.871248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.871371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.871504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.871630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.871755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.871879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] credential.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.872910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.873110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.873239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.873363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.873486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.873610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.873744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.873876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.874917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.875938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.876939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.877952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.878076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.878222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.878358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.878484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.878607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.878731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.878889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.879915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.880936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881563 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.881937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.882061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.882245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.882372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.882507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.882637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.882762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.882885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.883880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.884116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.884116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.884360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.884498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.884627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.884758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.884883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.885888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886289 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.886919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.887928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.888933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889828 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.889951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.890074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.890252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.890376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.890511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.890637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.890760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.890890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.891902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.892920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.893926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.894970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] role.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] role.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.895972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.896979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.901467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.902290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.902436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.902568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.902699 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.902828 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.902956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903476 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.903985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.904109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.904234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.904365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.904500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.904634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.904771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.904896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.905775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.906991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.907980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.908104 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.908238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.908371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.908496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.908627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.908753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.908877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.909886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.910027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.910309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] role.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.910435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.910559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] role.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.910682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.910819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.910945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.911967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.912957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913088 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.913970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.914111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.914243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.connection = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.914243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.914507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.914636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.914769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.914895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.915918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.916923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.917176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.917176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.917410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.917534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.917659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.917659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.917904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.918075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.918221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.918348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.918473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.918610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.918736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.918875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.919000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.connection = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.921051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.922111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.923217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.923217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.923217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 24 14:38:53.923217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 24 14:38:53.924189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.924414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.924843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.929159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.929394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.929622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.933680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.938402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.962289 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.962525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.965180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:53.965378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.017109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.017643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.066280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.066641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.066785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.066920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.132686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.132916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.133940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.134180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.134395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.157684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.157871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.157958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.158904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.159044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.159127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.170348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.170591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.183115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.183371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.183472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.183538 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.183611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.183777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.183916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.184001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.184075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.184149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.184229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.184388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.184527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.184611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86182) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 24 14:38:54.201539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.201746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 24 14:38:54.202107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.202247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.202332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 24 14:38:54.202407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 24 14:38:54.202562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.202685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.202799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.202900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 24 14:38:54.203081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.203205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.203286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.203359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.203587 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.203843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.214179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.214451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.214714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.214837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.214967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.215057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.215316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.215592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.223127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.223810 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.226338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.226611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.226879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.227002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.227133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.227311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.227435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.227599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.227723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.227841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.227945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.228140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.228263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.228370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.228472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.228662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.228763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.228928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.229053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.229172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.229457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.229715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.255174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.255689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.256749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.257022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.257265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.257542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.262235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.262629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.262751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.262895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.262987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.263353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.270156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.270402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.270538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.270818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.274825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.275104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.275226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.275352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.275461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.275653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.275777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.275900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.275991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.276155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.276279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.276469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.276736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.276947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.277066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.277257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.295357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.295473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.295673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.295776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.300103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.300200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.303776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.303961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.304094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.304249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.309032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.309210 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.312536 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.312717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.316070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.316251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.316384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.316532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.316656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.316850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.316975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.317100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.317221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.317342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.317472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.317595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.336577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.336759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.336891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.337041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.337166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.337286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.337647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.337815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.345012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.345207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.346705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.346886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.347018 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.347142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.350037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.350251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.350383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.350507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.350629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.350751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.350888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.351012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.351142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.351307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.364124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.364396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.364588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.364723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.364848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.364983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.365106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.365228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.365498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.365864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.366174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.366593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.366884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.367176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.383833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.384758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.387061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.387961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.390320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.391225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.393241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.394970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.395249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.395524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.402899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.404540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.407852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.408124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.495139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.497003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.497287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.497565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.504916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.506567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.509034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.509370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.509940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.510248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.510533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.510802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.518594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.518909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.519188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.519827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.520108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.520430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.526965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86182) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.527396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.527671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.527944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.528090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 24 14:38:54.528228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.528360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.528502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.528742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.528827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.529903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.530058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.530183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.530344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.530426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.530606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86182) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.530690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.530868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.531128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.531387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.531640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 24 14:38:54.568019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637ae1439c0 pid: 86182 (default app) Mar 24 14:38:54.569139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637ae1439c0 pid: 86181 (default app) Mar 24 14:38:54.571508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65988-cad9-476d-a913-600a4facb445 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:38:54.571797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65988-cad9-476d-a913-600a4facb445 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:38:54.572077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65988-cad9-476d-a913-600a4facb445 None None] PATH_INFO: `/v3` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:38:54.576388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Mar 24 14:38:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:02.797550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347f03-97fc-42b7-8412-fa6882d8a750 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:02.798173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347f03-97fc-42b7-8412-fa6882d8a750 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:02.798173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347f03-97fc-42b7-8412-fa6882d8a750 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:02.803263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:02.810016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:02.810796 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:02.810942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:02.851840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG oslo_db.sqlalchemy.engines [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 24 14:39:03.041689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG passlib.handlers.bcrypt [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86182) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 24 14:39:03.042065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG passlib.handlers.bcrypt [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86182) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 24 14:39:03.098722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:03.100334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:03.248750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 24 14:39:03.422515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42347f03-97fc-42b7-8412-fa6882d8a750 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:03.467915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG oslo_db.sqlalchemy.engines [None req-42347f03-97fc-42b7-8412-fa6882d8a750 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 24 14:39:03.596539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42347f03-97fc-42b7-8412-fa6882d8a750 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:03.601900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41777cd-38aa-446d-b01f-9d093db26071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:03.602578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41777cd-38aa-446d-b01f-9d093db26071 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:03.602854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41777cd-38aa-446d-b01f-9d093db26071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:03.603123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41777cd-38aa-446d-b01f-9d093db26071 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:03.612117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41777cd-38aa-446d-b01f-9d093db26071 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:03.662102 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a41777cd-38aa-446d-b01f-9d093db26071 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 24 14:39:03.662440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41777cd-38aa-446d-b01f-9d093db26071 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:03.672357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Mar 24 14:39:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:39:03.682456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:03.700496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d97ae-b150-4eec-b968-45a9aae8f484 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:03.707361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d07e15-f191-430a-90dc-26d7ff58d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:03.708502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d07e15-f191-430a-90dc-26d7ff58d486 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:03.708787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d07e15-f191-430a-90dc-26d7ff58d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:03.709067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d07e15-f191-430a-90dc-26d7ff58d486 admin admin] PATH_INFO: `/v3/projects/3c10c7d278dd470682481e8cf01ddafe` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:03.710824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d07e15-f191-430a-90dc-26d7ff58d486 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c10c7d278dd470682481e8cf01ddafe)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:03.761881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.common.rbac_enforcer.enforcer [None req-41d07e15-f191-430a-90dc-26d7ff58d486 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 24 14:39:03.762240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d07e15-f191-430a-90dc-26d7ff58d486 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:03.766901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Mar 24 14:39:03 2022] GET /identity/v3/projects/3c10c7d278dd470682481e8cf01ddafe => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:06.004432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca16113-a047-4d1a-8a89-e4ef9a046bc3 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:06.005235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca16113-a047-4d1a-8a89-e4ef9a046bc3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:06.005338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca16113-a047-4d1a-8a89-e4ef9a046bc3 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:06.012869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:06.019464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d43b0-45be-4bb3-b77a-09c0b5d45530 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:06.020194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d43b0-45be-4bb3-b77a-09c0b5d45530 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:06.020341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d43b0-45be-4bb3-b77a-09c0b5d45530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:06.043939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e76d43b0-45be-4bb3-b77a-09c0b5d45530 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:06.045422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e76d43b0-45be-4bb3-b77a-09c0b5d45530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:06.054071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 24 14:39:06.076734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca16113-a047-4d1a-8a89-e4ef9a046bc3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:06.098670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca16113-a047-4d1a-8a89-e4ef9a046bc3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:06.104889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cec85-76e6-42b4-9b80-f667f842fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:06.105524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cec85-76e6-42b4-9b80-f667f842fa8a admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:06.105769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cec85-76e6-42b4-9b80-f667f842fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:06.106035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cec85-76e6-42b4-9b80-f667f842fa8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:06.114107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cec85-76e6-42b4-9b80-f667f842fa8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:06.115894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cec85-76e6-42b4-9b80-f667f842fa8a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:06.124584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Mar 24 14:39:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:39:06.130149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d43b0-45be-4bb3-b77a-09c0b5d45530 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:06.140023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d43b0-45be-4bb3-b77a-09c0b5d45530 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:06.145691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323047b-0f2a-4338-8d6c-97a91f895037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:06.146583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323047b-0f2a-4338-8d6c-97a91f895037 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:06.146863 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323047b-0f2a-4338-8d6c-97a91f895037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:06.147134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323047b-0f2a-4338-8d6c-97a91f895037 admin admin] PATH_INFO: `/v3/users/bdaa46363cd34630bc53ea00cbbbe37d` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:06.148633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323047b-0f2a-4338-8d6c-97a91f895037 admin admin] RBAC: Authorizing `identity:get_user(user_id=bdaa46363cd34630bc53ea00cbbbe37d)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:06.150506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323047b-0f2a-4338-8d6c-97a91f895037 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:06.152206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Mar 24 14:39:06 2022] GET /identity/v3/users/bdaa46363cd34630bc53ea00cbbbe37d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:08.488287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf19f-31bd-4121-80cd-8bab3783045b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:08.488883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf19f-31bd-4121-80cd-8bab3783045b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:08.488883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf19f-31bd-4121-80cd-8bab3783045b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:08.490664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:08.495986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158aa6b-8ab2-4226-8d4f-5f4ce716c265 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:08.496458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158aa6b-8ab2-4226-8d4f-5f4ce716c265 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:08.496558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158aa6b-8ab2-4226-8d4f-5f4ce716c265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:08.510145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeee25-a317-47ca-819e-d90289827ed1 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:08.510458 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeee25-a317-47ca-819e-d90289827ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:08.510729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeee25-a317-47ca-819e-d90289827ed1 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:08.512460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:08.513734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8158aa6b-8ab2-4226-8d4f-5f4ce716c265 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:08.514940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8158aa6b-8ab2-4226-8d4f-5f4ce716c265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:08.517237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:08.517531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:08.517807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:08.558622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG passlib.handlers.bcrypt [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 24 14:39:08.559035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG passlib.handlers.bcrypt [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 24 14:39:08.594476 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:08.605161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:08.606790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:08.617537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158aa6b-8ab2-4226-8d4f-5f4ce716c265 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:08.706995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:08.716100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158aa6b-8ab2-4226-8d4f-5f4ce716c265 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:08.729941 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:08.749424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:08.750174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:08.750432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:08.750718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:08.762131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:08.768978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:08.770248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:08.776025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:08.825050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4824b-dd3d-4ee9-959e-56af62755c18 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:08.860977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:08.861874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:08.862155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:08.862459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:08.876381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa84b8-1695-4487-9aa3-7b701750e538 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:08.909747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:08.910488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:08.910789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:08.911100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:08.911853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:08.912160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:08.913555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:08.926467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:08.927597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:08.929097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:08.931981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:09.020256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:09.026000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:09.027691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6efb02-1933-4d97-a57d-71c260ae686f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:09.058978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:09.059841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:09.060123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:09.060399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] PATH_INFO: `/v3/users/bdaa46363cd34630bc53ea00cbbbe37d` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:09.061603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] RBAC: Authorizing `identity:get_user(user_id=bdaa46363cd34630bc53ea00cbbbe37d)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:09.063086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:09.066456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:08 2022] GET /identity/v3/users/bdaa46363cd34630bc53ea00cbbbe37d => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:09.069861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:09.121331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d83150-5114-4ba2-9e69-8fb836a29165 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:09.156314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:09.157115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:09.157390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:09.157729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:09.166408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1c48-5cba-413b-8d02-f860dde0f97b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:09.177750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:09.179262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:09.196194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:39:09.197383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:09.200514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:09.201313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:09.201599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:09.201875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:09.203133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:09.203236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:09.204648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:09.206661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:09.212241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:09.300076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546d6c-a6aa-496e-a97a-8b4a8ea53077 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:09.308679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00cc7e-7d82-4762-bbc4-748e3e21c246 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:09.333639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae06b0b-e0b9-4cdb-87c6-20f19b95eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:09.334308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06b0b-e0b9-4cdb-87c6-20f19b95eded None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:09.334603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06b0b-e0b9-4cdb-87c6-20f19b95eded None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:09.334879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06b0b-e0b9-4cdb-87c6-20f19b95eded None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:09.335608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06b0b-e0b9-4cdb-87c6-20f19b95eded None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:09.335925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06b0b-e0b9-4cdb-87c6-20f19b95eded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:09.337311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06b0b-e0b9-4cdb-87c6-20f19b95eded None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:09.341786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7ce18-3d29-4434-99b2-5547de627fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:09.342463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ce18-3d29-4434-99b2-5547de627fb5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:09.342741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ce18-3d29-4434-99b2-5547de627fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:09.343014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ce18-3d29-4434-99b2-5547de627fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:09.343830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7ce18-3d29-4434-99b2-5547de627fb5 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.domain.id=default, user.id=bdaa46363cd34630bc53ea00cbbbe37d) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:09.344137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7ce18-3d29-4434-99b2-5547de627fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:09.345570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7ce18-3d29-4434-99b2-5547de627fb5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:09.352120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Mar 24 14:39:09 2022] GET /identity/v3/role_assignments?user.id=bdaa46363cd34630bc53ea00cbbbe37d&scope.domain.id=default&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:09.354937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:12.065167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d15fd-d0ec-491d-a6d4-853dd8ab2283 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.066289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d15fd-d0ec-491d-a6d4-853dd8ab2283 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.066782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d15fd-d0ec-491d-a6d4-853dd8ab2283 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.069024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:12.074736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2021-d4aa-44d4-8801-9129b4da13b6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.075177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2021-d4aa-44d4-8801-9129b4da13b6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.075286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2021-d4aa-44d4-8801-9129b4da13b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.094365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c63e2021-d4aa-44d4-8801-9129b4da13b6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:12.095819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c63e2021-d4aa-44d4-8801-9129b4da13b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:12.187068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:12.221349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d15fd-d0ec-491d-a6d4-853dd8ab2283 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:12.363796 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d15fd-d0ec-491d-a6d4-853dd8ab2283 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:12.405555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572240-d214-4d89-be68-c7e2e9de0d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:12.406620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572240-d214-4d89-be68-c7e2e9de0d5a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.407065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572240-d214-4d89-be68-c7e2e9de0d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.407472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572240-d214-4d89-be68-c7e2e9de0d5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.421773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed572240-d214-4d89-be68-c7e2e9de0d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:12.429004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ed572240-d214-4d89-be68-c7e2e9de0d5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:12.430456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 13/24] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:12.436672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2021-d4aa-44d4-8801-9129b4da13b6 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:12.489489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81514b4-95ee-4950-8897-940f9fd59d0b None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.490009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81514b4-95ee-4950-8897-940f9fd59d0b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.490468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81514b4-95ee-4950-8897-940f9fd59d0b None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.492676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 14/25] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:12.497564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986e96-6512-46fe-afff-b3e13933589d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.498120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986e96-6512-46fe-afff-b3e13933589d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.498583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986e96-6512-46fe-afff-b3e13933589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.527075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-93986e96-6512-46fe-afff-b3e13933589d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:12.528915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-93986e96-6512-46fe-afff-b3e13933589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:12.555067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2021-d4aa-44d4-8801-9129b4da13b6 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:12.590486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d77c-9619-4ac1-aed5-53ee2e1e1501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:12.591519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d77c-9619-4ac1-aed5-53ee2e1e1501 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.592007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d77c-9619-4ac1-aed5-53ee2e1e1501 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.592473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d77c-9619-4ac1-aed5-53ee2e1e1501 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.593410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d77c-9619-4ac1-aed5-53ee2e1e1501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:12.593913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d77c-9619-4ac1-aed5-53ee2e1e1501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:12.595547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d77c-9619-4ac1-aed5-53ee2e1e1501 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:12.613424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 12/26] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:12.615137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525efeb1-2208-447c-88ca-fe1b605f1cc4 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.615615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525efeb1-2208-447c-88ca-fe1b605f1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.616097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525efeb1-2208-447c-88ca-fe1b605f1cc4 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.618275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:12.619872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525efeb1-2208-447c-88ca-fe1b605f1cc4 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:12.623019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:12.628246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5f59a-07ee-4e08-b902-e712d147ed00 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.628843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5f59a-07ee-4e08-b902-e712d147ed00 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.634263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5f59a-07ee-4e08-b902-e712d147ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.656186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b4d5f59a-07ee-4e08-b902-e712d147ed00 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:12.657849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b4d5f59a-07ee-4e08-b902-e712d147ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:12.770419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:12.771274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5f59a-07ee-4e08-b902-e712d147ed00 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:12.805994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525efeb1-2208-447c-88ca-fe1b605f1cc4 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:12.842849 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:12.844310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:12.844780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:12.845262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] PATH_INFO: `/v3/users/bdaa46363cd34630bc53ea00cbbbe37d` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:12.847069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] RBAC: Authorizing `identity:get_user(user_id=bdaa46363cd34630bc53ea00cbbbe37d)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:12.849233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:12.855033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 14/30] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:12 2022] GET /identity/v3/users/bdaa46363cd34630bc53ea00cbbbe37d => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:12.856186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:12.960201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5f59a-07ee-4e08-b902-e712d147ed00 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:12.970131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249263eb-dfa7-48ea-a2ee-2b7131081b67 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:13.006505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d724a2-0e40-47c3-9f00-ae66f4161c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.006703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.007477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.007817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.007922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d724a2-0e40-47c3-9f00-ae66f4161c57 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.008185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.008531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d724a2-0e40-47c3-9f00-ae66f4161c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.008985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d724a2-0e40-47c3-9f00-ae66f4161c57 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.009921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d724a2-0e40-47c3-9f00-ae66f4161c57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.011506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d724a2-0e40-47c3-9f00-ae66f4161c57 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.019798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.022438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.040286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:39:13.041497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 17/31] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:13.042496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:13.139391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33e477-06e6-4e8e-8f88-70adf67c85d3 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:13.141735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 15/32] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Mar 24 14:39:12 2022] POST /identity/v3/roles => generated 225 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:13.143962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcf78-15d8-4428-9532-08aa2ceb1e8e None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.144536 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcf78-15d8-4428-9532-08aa2ceb1e8e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.145045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bcf78-15d8-4428-9532-08aa2ceb1e8e None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.147190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:13.148287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bcf78-15d8-4428-9532-08aa2ceb1e8e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:13.176819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec50413-bd88-42f3-b2aa-c53c47f1ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.177929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50413-bd88-42f3-b2aa-c53c47f1ef65 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.178372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50413-bd88-42f3-b2aa-c53c47f1ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.178778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50413-bd88-42f3-b2aa-c53c47f1ef65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.180215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec50413-bd88-42f3-b2aa-c53c47f1ef65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.181954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec50413-bd88-42f3-b2aa-c53c47f1ef65 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.188616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 18/34] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:13.188616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805e49-1d76-4b0e-aae9-2957fba24678 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.188616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805e49-1d76-4b0e-aae9-2957fba24678 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.188616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805e49-1d76-4b0e-aae9-2957fba24678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.211456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-83805e49-1d76-4b0e-aae9-2957fba24678 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:13.213439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-83805e49-1d76-4b0e-aae9-2957fba24678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:13.267796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bcf78-15d8-4428-9532-08aa2ceb1e8e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:13.288652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 19/35] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:13.289791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83805e49-1d76-4b0e-aae9-2957fba24678 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:13.307007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2f016-5926-43ba-8466-20bee4e5e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.307898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2f016-5926-43ba-8466-20bee4e5e292 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.308279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2f016-5926-43ba-8466-20bee4e5e292 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.308654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2f016-5926-43ba-8466-20bee4e5e292 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.309616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2f016-5926-43ba-8466-20bee4e5e292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:13.310033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2f016-5926-43ba-8466-20bee4e5e292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.311789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2f016-5926-43ba-8466-20bee4e5e292 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.324685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 17/36] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:13.326925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0503-7d51-47d1-9040-1e8348554147 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.327359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0503-7d51-47d1-9040-1e8348554147 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.327856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0503-7d51-47d1-9040-1e8348554147 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.330494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 18/37] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:13.331608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf0503-7d51-47d1-9040-1e8348554147 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:13.399690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83805e49-1d76-4b0e-aae9-2957fba24678 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:13.445425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc872c1e-3d39-4692-bd5f-23b4c47aa71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.446455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc872c1e-3d39-4692-bd5f-23b4c47aa71e None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.446723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc872c1e-3d39-4692-bd5f-23b4c47aa71e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.446945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc872c1e-3d39-4692-bd5f-23b4c47aa71e None admin] PATH_INFO: `/v3/domains/default/users/bdaa46363cd34630bc53ea00cbbbe37d/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.448962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc872c1e-3d39-4692-bd5f-23b4c47aa71e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bdaa46363cd34630bc53ea00cbbbe37d, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.450484 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc872c1e-3d39-4692-bd5f-23b4c47aa71e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.454581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf0503-7d51-47d1-9040-1e8348554147 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:13.489908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.490608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.490980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.491263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.492016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.493391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.506711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 19/38] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Mar 24 14:39:13 2022] POST /identity/v3/roles => generated 219 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:13.507861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:13.566235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 20/39] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Mar 24 14:39:13 2022] PUT /identity/v3/domains/default/users/bdaa46363cd34630bc53ea00cbbbe37d/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:13.568094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff896-284d-4c30-a44b-57739bc84dc3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.568388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff896-284d-4c30-a44b-57739bc84dc3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.568670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ff896-284d-4c30-a44b-57739bc84dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.598117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-041ff896-284d-4c30-a44b-57739bc84dc3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:13.598117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-041ff896-284d-4c30-a44b-57739bc84dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:13.698305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141714ff-a067-456c-a884-770ffc0491ed None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:13.720479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 21/40] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:13.722291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815325dd-6694-42e0-8c5e-f633d1f8bebd None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.722291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815325dd-6694-42e0-8c5e-f633d1f8bebd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.722291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815325dd-6694-42e0-8c5e-f633d1f8bebd None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.728193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 22/41] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:13.735420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8685cc-52e5-4beb-a0a8-ef765aeafea6 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.735706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8685cc-52e5-4beb-a0a8-ef765aeafea6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.735988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8685cc-52e5-4beb-a0a8-ef765aeafea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.753072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.754060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.754467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.754784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.755657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.757242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.757709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9b8685cc-52e5-4beb-a0a8-ef765aeafea6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:13.758974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9b8685cc-52e5-4beb-a0a8-ef765aeafea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:13.792735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 20/42] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:39:13 2022] POST /identity/v3/projects => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:13.793871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:13.857737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 23/43] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:13.882222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8685cc-52e5-4beb-a0a8-ef765aeafea6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:13.940920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137441c2-4426-43e3-8493-0649ee80937d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:13.979643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:13.980334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:13.980622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:13.980904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:13.981675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:13.983155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:13.999011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 21/44] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Mar 24 14:39:13 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:14.014392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8685cc-52e5-4beb-a0a8-ef765aeafea6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:14.056324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b81f4-3840-40ad-915b-068947090444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:14.057142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b81f4-3840-40ad-915b-068947090444 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:14.057432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b81f4-3840-40ad-915b-068947090444 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:14.057706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b81f4-3840-40ad-915b-068947090444 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:14.058994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b81f4-3840-40ad-915b-068947090444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:14.061132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b81f4-3840-40ad-915b-068947090444 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:14.062293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 24/45] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:14.068082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:14.170968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452532de-5147-4ece-85a2-f04e7a479f9a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:14.205324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7e2c9-9810-4634-a395-70e509038e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:14.206003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e2c9-9810-4634-a395-70e509038e83 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:14.206408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e2c9-9810-4634-a395-70e509038e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:14.206719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e2c9-9810-4634-a395-70e509038e83 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:14.207451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7e2c9-9810-4634-a395-70e509038e83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:14.209012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7e2c9-9810-4634-a395-70e509038e83 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:14.237448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 22/46] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:39:14 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:15.885935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6be98-da76-4cc3-9679-40f9c297695c None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:15.886519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6be98-da76-4cc3-9679-40f9c297695c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:15.886519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6be98-da76-4cc3-9679-40f9c297695c None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:15.888312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 25/47] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:15.893737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c96a-56e1-49bf-9ac8-3cd488569287 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:15.894266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c96a-56e1-49bf-9ac8-3cd488569287 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:15.894379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c96a-56e1-49bf-9ac8-3cd488569287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:15.911522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-42d3c96a-56e1-49bf-9ac8-3cd488569287 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:15.913007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-42d3c96a-56e1-49bf-9ac8-3cd488569287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:15.983483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 23/48] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:16.006483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6be98-da76-4cc3-9679-40f9c297695c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:16.106644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6be98-da76-4cc3-9679-40f9c297695c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:16.140167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:16.140893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.141175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.141438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.154516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:16.161645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:16.163228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 26/49] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:16.169074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c96a-56e1-49bf-9ac8-3cd488569287 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:16.264956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c96a-56e1-49bf-9ac8-3cd488569287 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:16.298295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:16.298958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.299242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.299498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.300274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:16.300584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:16.301975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:16.310024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 24/50] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:16.315728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:16.416527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b6f73-1057-446f-9609-7b49e203eae1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:16.449717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f1282-5c25-4715-a7f3-151e82327a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:16.450645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f1282-5c25-4715-a7f3-151e82327a4e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.450928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f1282-5c25-4715-a7f3-151e82327a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.451201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f1282-5c25-4715-a7f3-151e82327a4e None admin] PATH_INFO: `/v3/users/bdaa46363cd34630bc53ea00cbbbe37d` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.452556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f1282-5c25-4715-a7f3-151e82327a4e None admin] RBAC: Authorizing `identity:get_user(user_id=bdaa46363cd34630bc53ea00cbbbe37d)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:16.454038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f1282-5c25-4715-a7f3-151e82327a4e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:16.456000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 27/51] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:16 2022] GET /identity/v3/users/bdaa46363cd34630bc53ea00cbbbe37d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:16.461918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:16.500586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f0312-19bc-4d95-87fe-856f54b52c61 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.500919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f0312-19bc-4d95-87fe-856f54b52c61 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.501219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f0312-19bc-4d95-87fe-856f54b52c61 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.503310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 28/52] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:16.508534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012ca7-6406-42aa-b2a7-0e016651c923 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.508822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012ca7-6406-42aa-b2a7-0e016651c923 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.509129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012ca7-6406-42aa-b2a7-0e016651c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.526613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-cd012ca7-6406-42aa-b2a7-0e016651c923 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:16.527801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cd012ca7-6406-42aa-b2a7-0e016651c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:16.557217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed618-7f15-405a-8b21-54fe6f32213e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:16.589932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:16.590764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.591039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.591314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.592528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:16.593962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:16.594827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 29/53] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:16.595583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 25/54] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:16.601263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd012ca7-6406-42aa-b2a7-0e016651c923 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:16.618036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:16.694956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd012ca7-6406-42aa-b2a7-0e016651c923 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:16.713193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691a90c-ea1d-4357-b2a3-28b8f084efdd None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:16.727822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:16.728467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.728747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.729023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.729846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.domain.id=default, user.id=bdaa46363cd34630bc53ea00cbbbe37d) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:16.730177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:16.731615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:16.737170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 30/55] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Mar 24 14:39:16 2022] GET /identity/v3/role_assignments?user.id=bdaa46363cd34630bc53ea00cbbbe37d&scope.domain.id=default&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 530 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:16.745150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aad2d2-a95d-4317-896e-323c4457e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:16.745966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aad2d2-a95d-4317-896e-323c4457e3dc None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.746272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aad2d2-a95d-4317-896e-323c4457e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.746552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aad2d2-a95d-4317-896e-323c4457e3dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.747795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aad2d2-a95d-4317-896e-323c4457e3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:16.749275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aad2d2-a95d-4317-896e-323c4457e3dc None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:16.751010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 26/56] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:16.756905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:16.860347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec642-bcec-4ce3-a2bc-a5a1f30ea8e7 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:16.898687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36794136-d65e-4249-ba3a-32b1bd509284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:16.900268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794136-d65e-4249-ba3a-32b1bd509284 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:16.900479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794136-d65e-4249-ba3a-32b1bd509284 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:16.900811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794136-d65e-4249-ba3a-32b1bd509284 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:16.901551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36794136-d65e-4249-ba3a-32b1bd509284 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:16.903037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36794136-d65e-4249-ba3a-32b1bd509284 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:16.932624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 31/57] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Mar 24 14:39:16 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:39:19.207532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64446-0eb2-4bbf-ae4d-12fa164b45a0 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:19.208312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64446-0eb2-4bbf-ae4d-12fa164b45a0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:19.208312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64446-0eb2-4bbf-ae4d-12fa164b45a0 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:19.211237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 27/58] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:19.217428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0ac5-7864-46cf-8282-cc25c0a5febf None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:19.218200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0ac5-7864-46cf-8282-cc25c0a5febf None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:19.218364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0ac5-7864-46cf-8282-cc25c0a5febf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:19.238653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a36a0ac5-7864-46cf-8282-cc25c0a5febf None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:19.239819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a36a0ac5-7864-46cf-8282-cc25c0a5febf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:19.307593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:19.335287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64446-0eb2-4bbf-ae4d-12fa164b45a0 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:19.441636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64446-0eb2-4bbf-ae4d-12fa164b45a0 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:19.475100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a462e-8917-4a38-92be-f460da0b4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:19.475819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a462e-8917-4a38-92be-f460da0b4af6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:19.476098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a462e-8917-4a38-92be-f460da0b4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:19.476381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a462e-8917-4a38-92be-f460da0b4af6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:19.477706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a462e-8917-4a38-92be-f460da0b4af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:19.479191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a462e-8917-4a38-92be-f460da0b4af6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:19.480785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 28/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:19.486402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a0ac5-7864-46cf-8282-cc25c0a5febf None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:19.581032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a0ac5-7864-46cf-8282-cc25c0a5febf None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:19.613937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf56c9-705d-41b9-975a-b8521d3c2adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:19.614621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf56c9-705d-41b9-975a-b8521d3c2adf None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:19.614906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf56c9-705d-41b9-975a-b8521d3c2adf None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:19.615134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf56c9-705d-41b9-975a-b8521d3c2adf None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:19.615870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf56c9-705d-41b9-975a-b8521d3c2adf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:19.617312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf56c9-705d-41b9-975a-b8521d3c2adf None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:19.643607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 33/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:39:19 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:23.141355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c97b-5b94-4e61-b404-196b5968a652 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.142404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c97b-5b94-4e61-b404-196b5968a652 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.142963 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c97b-5b94-4e61-b404-196b5968a652 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.145317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 29/62] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:23.151233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a59c8-74c0-47dd-a021-54a15fcee02f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.152087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a59c8-74c0-47dd-a021-54a15fcee02f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.152532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a59c8-74c0-47dd-a021-54a15fcee02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.183128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-318a59c8-74c0-47dd-a021-54a15fcee02f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:23.184619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-318a59c8-74c0-47dd-a021-54a15fcee02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:23.231786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93d74c-a24d-4095-8460-3e574933efc3 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.232349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93d74c-a24d-4095-8460-3e574933efc3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.232796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93d74c-a24d-4095-8460-3e574933efc3 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.234983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 30/63] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:23.240114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b4fb-158f-4100-889d-fd4288357f9b None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.240619 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b4fb-158f-4100-889d-fd4288357f9b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.241065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b4fb-158f-4100-889d-fd4288357f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.263645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 34/64] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:23.279109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-dcb2b4fb-158f-4100-889d-fd4288357f9b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:23.280289 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-dcb2b4fb-158f-4100-889d-fd4288357f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:23.305965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a59c8-74c0-47dd-a021-54a15fcee02f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.371269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 31/65] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:23.372962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66887-98ba-47d8-bb53-e63c5f36ca6f None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.373478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66887-98ba-47d8-bb53-e63c5f36ca6f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.373944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66887-98ba-47d8-bb53-e63c5f36ca6f None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.376180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 32/66] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:23.381571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55f6ac-3287-4c54-a88a-7e2769469789 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.382115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55f6ac-3287-4c54-a88a-7e2769469789 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.382591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55f6ac-3287-4c54-a88a-7e2769469789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.405379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4a55f6ac-3287-4c54-a88a-7e2769469789 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:23.405537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a59c8-74c0-47dd-a021-54a15fcee02f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:23.406515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4a55f6ac-3287-4c54-a88a-7e2769469789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:23.438774 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:23.439820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.440242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.440712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.452122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:23.459922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:23.461708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 35/67] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:23.467439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.473569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 33/68] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:23.474499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55f6ac-3287-4c54-a88a-7e2769469789 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.564120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cc4e-320d-47e1-b194-346036fba149 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:23.568839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55f6ac-3287-4c54-a88a-7e2769469789 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:23.595763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:23.596658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.597049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.597482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.602134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af121b7-cc0d-47e8-addb-bbc2a6c6667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:23.602802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af121b7-cc0d-47e8-addb-bbc2a6c6667c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.603086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af121b7-cc0d-47e8-addb-bbc2a6c6667c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.603359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af121b7-cc0d-47e8-addb-bbc2a6c6667c None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.604227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af121b7-cc0d-47e8-addb-bbc2a6c6667c None admin] RBAC: Adding query filter params (name=member) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:23.604412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af121b7-cc0d-47e8-addb-bbc2a6c6667c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:23.605797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af121b7-cc0d-47e8-addb-bbc2a6c6667c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:23.607564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:23.618399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:23.618556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:23.618629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004203a-b0cd-4310-9b0c-e6e19f37fc0f None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.618629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004203a-b0cd-4310-9b0c-e6e19f37fc0f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.618629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004203a-b0cd-4310-9b0c-e6e19f37fc0f None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.618816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 36/70] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:23.618816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.618925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 35/71] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:23.622355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004203a-b0cd-4310-9b0c-e6e19f37fc0f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.717963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b404ac3-8322-488a-ac32-6cded15d8acf None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:23.718488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004203a-b0cd-4310-9b0c-e6e19f37fc0f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:23.749905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d9bd9-5a3c-44fc-ad96-7b0efae3dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:23.750288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:23.750740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9bd9-5a3c-44fc-ad96-7b0efae3dfbe None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.751021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9bd9-5a3c-44fc-ad96-7b0efae3dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.751170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.751315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d9bd9-5a3c-44fc-ad96-7b0efae3dfbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.751464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.751769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.761045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d9bd9-5a3c-44fc-ad96-7b0efae3dfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:23.766278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:23.767732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:23.768196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-197d9bd9-5a3c-44fc-ad96-7b0efae3dfbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:39:23.778384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:23.778543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:23.778621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e5a61-b77c-43a7-85d3-e00edf78b1e3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.778686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.778749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e5a61-b77c-43a7-85d3-e00edf78b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.778749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e5a61-b77c-43a7-85d3-e00edf78b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.792782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-790e5a61-b77c-43a7-85d3-e00edf78b1e3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:23.793984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-790e5a61-b77c-43a7-85d3-e00edf78b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:23.857743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 38/74] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:23.870421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e5a61-b77c-43a7-85d3-e00edf78b1e3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.870507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dbdd3-cbf1-4cc1-97e8-53c5b1b11b9c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:23.903792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:23.904466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:23.904746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:23.905016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:23.905762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:23.906062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:23.907465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:23.915479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:23.916255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:23.968761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e5a61-b77c-43a7-85d3-e00edf78b1e3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.004564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.005209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.005491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.005765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.015589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6655738-fc42-4e36-8b49-af9707be2db2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.052898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f5086-1610-43ba-9b69-ac7223b08edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.053553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5086-1610-43ba-9b69-ac7223b08edd None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.053838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5086-1610-43ba-9b69-ac7223b08edd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.054113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f5086-1610-43ba-9b69-ac7223b08edd None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.054899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5086-1610-43ba-9b69-ac7223b08edd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:24.055186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5086-1610-43ba-9b69-ac7223b08edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.056566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f5086-1610-43ba-9b69-ac7223b08edd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.064416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 38/76] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:24.066858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafd9c8-0759-451f-89a4-01538c7ba831 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.067150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafd9c8-0759-451f-89a4-01538c7ba831 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.067428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafd9c8-0759-451f-89a4-01538c7ba831 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.069153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 39/77] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:24.069848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafd9c8-0759-451f-89a4-01538c7ba831 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.074033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.075538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.168427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafd9c8-0759-451f-89a4-01538c7ba831 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.170581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 39/78] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:24.171705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.201541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.202375 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.202664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.202945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.214542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:24.221419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:24.222642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 40/79] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:24.223400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.266023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3feadc-e87f-4c62-a8a5-3a6c46efc13a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.299117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d843122-376a-44e7-88c8-7588ccf85a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.300058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843122-376a-44e7-88c8-7588ccf85a2d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.300344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843122-376a-44e7-88c8-7588ccf85a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.300625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843122-376a-44e7-88c8-7588ccf85a2d None admin] PATH_INFO: `/v3/users/bdaa46363cd34630bc53ea00cbbbe37d` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.301831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d843122-376a-44e7-88c8-7588ccf85a2d None admin] RBAC: Authorizing `identity:get_user(user_id=bdaa46363cd34630bc53ea00cbbbe37d)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.303301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d843122-376a-44e7-88c8-7588ccf85a2d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.304935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 40/80] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/users/bdaa46363cd34630bc53ea00cbbbe37d => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:24.306183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341bf0a-c108-4c73-91a7-1ff5c67189ea None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.306478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341bf0a-c108-4c73-91a7-1ff5c67189ea None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.306760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341bf0a-c108-4c73-91a7-1ff5c67189ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.318524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4e75e-c782-43a4-9614-8bed14fb2a86 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.323967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7341bf0a-c108-4c73-91a7-1ff5c67189ea None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:24.325162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7341bf0a-c108-4c73-91a7-1ff5c67189ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:24.355145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.356019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.356311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.356571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.357820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.359319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.361240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:24.362107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.390636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:24.391531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341bf0a-c108-4c73-91a7-1ff5c67189ea None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.455140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80b3f9-4112-4309-8c32-931d7d3b17d8 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.481799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341bf0a-c108-4c73-91a7-1ff5c67189ea None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.485917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.486805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.487090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.487383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.488599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.490026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.491906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 42/83] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:24.492471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.514856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.515525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.515807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.516083 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.516830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:24.517132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.518557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.526481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 42/84] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:24.527251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.587753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c16bd1-dafc-488a-a407-818e3c316997 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.620274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.620924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.621205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.621482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.622641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5c73c-952a-4af7-9731-d5b26dcd1298 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.654653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.655316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.655597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.655873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.684993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.686489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.720121 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.721591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.776959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 43/85] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:24.777515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.817765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 43/86] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:24.823022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.876306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43815a0-6ecc-4531-8349-1b9371760bb0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.909597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.910422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.910703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.910974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.912151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.913605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.915260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 44/87] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:24.916011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:24.918935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae3f4-e805-479d-b891-fd76130dc685 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:24.950954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:24.951608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:24.951894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:24.952172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:24.953002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=de278bb29838403d8ea329a83f4047be) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:24.953317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:24.955160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:24.960399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 44/88] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/role_assignments?user.id=de278bb29838403d8ea329a83f4047be&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=610442154bc84cae961360db5432b95b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:24.961225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.017516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534024df-2fa7-483e-b1d7-9b636373470c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.054647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.055456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.055745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.056023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.057316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.058827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.060558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 45/89] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:25.061445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.066894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175379f-02c5-4592-ba19-3040927a3eb4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.101274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.102194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.102493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.102770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.104041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.105531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.112493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 45/90] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:24 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:25.112493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.165460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976db4b-64ad-4be7-89c4-60d8395e6165 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.198024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.199659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.200163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.200639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.202020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.203605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.205749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 46/91] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:25 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:25.209050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dccad-be71-4798-9958-7c96b9e881ef None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.211042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.240151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.240836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.241123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.241404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.242147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.243732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.274113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 46/92] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:39:25 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:25.274113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.311148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849cc4e-ebf2-4c05-833c-b9080e73ec37 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.349013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.349722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.350011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.350336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.405353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3662f28-34ba-4c5b-84c3-1f31c03270fd None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.426341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.427846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.447907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.448580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.448862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.449143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.450472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=bdaa46363cd34630bc53ea00cbbbe37d) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:25.451059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.453010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.460213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 47/93] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:25 2022] GET /identity/v3/role_assignments?user.id=bdaa46363cd34630bc53ea00cbbbe37d&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:25.461016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.544921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 47/94] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:25.551159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.593322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de893eb-3563-4037-b822-fa02a29cbbd1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.644066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.645443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.646069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.646673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.647782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] RBAC: Adding query filter params (role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=de278bb29838403d8ea329a83f4047be) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:25.648431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.650931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.658668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 48/95] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:25 2022] GET /identity/v3/role_assignments?user.id=de278bb29838403d8ea329a83f4047be&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:25.674700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9f70b-3295-4918-a8ed-58b070f17326 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.718124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d1ab4-3625-4a9f-8bc3-f81a236176be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.719017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d1ab4-3625-4a9f-8bc3-f81a236176be None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.719297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d1ab4-3625-4a9f-8bc3-f81a236176be None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.719569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d1ab4-3625-4a9f-8bc3-f81a236176be None admin] PATH_INFO: `/v3/projects/4e9f3895b53946e7b2a482005be430e9` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.720824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d1ab4-3625-4a9f-8bc3-f81a236176be None admin] RBAC: Authorizing `identity:get_project(project_id=4e9f3895b53946e7b2a482005be430e9)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.722420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d1ab4-3625-4a9f-8bc3-f81a236176be None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.724434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:25 2022] GET /identity/v3/projects/4e9f3895b53946e7b2a482005be430e9 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:25.730339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:25.865309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7edb04-33e7-4d9e-97b6-17381754e04f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:25.907487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2190dd2-fb99-4b6e-843d-1f2594a81067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:25.908174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190dd2-fb99-4b6e-843d-1f2594a81067 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:25.908463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190dd2-fb99-4b6e-843d-1f2594a81067 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:25.908739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190dd2-fb99-4b6e-843d-1f2594a81067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:25.909651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2190dd2-fb99-4b6e-843d-1f2594a81067 None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, scope.project.id=4e9f3895b53946e7b2a482005be430e9, user.id=de278bb29838403d8ea329a83f4047be) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:25.909970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2190dd2-fb99-4b6e-843d-1f2594a81067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:25.911469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2190dd2-fb99-4b6e-843d-1f2594a81067 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:25.918549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 49/97] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:25 2022] GET /identity/v3/role_assignments?user.id=de278bb29838403d8ea329a83f4047be&scope.project.id=4e9f3895b53946e7b2a482005be430e9&role.id=610442154bc84cae961360db5432b95b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:27.771383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1188b7-15ff-4ea4-8fea-50cd3a356e18 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:27.772431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1188b7-15ff-4ea4-8fea-50cd3a356e18 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:27.772910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1188b7-15ff-4ea4-8fea-50cd3a356e18 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:27.774952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 49/98] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:27.791958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e841d6-e5a0-4a81-bca4-96d77e8c721c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:27.792890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e841d6-e5a0-4a81-bca4-96d77e8c721c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:27.793385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e841d6-e5a0-4a81-bca4-96d77e8c721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:27.815494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c1e841d6-e5a0-4a81-bca4-96d77e8c721c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:27.816999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c1e841d6-e5a0-4a81-bca4-96d77e8c721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:27.908041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 50/99] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:27.942678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1188b7-15ff-4ea4-8fea-50cd3a356e18 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:28.071908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1188b7-15ff-4ea4-8fea-50cd3a356e18 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:28.109577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:28.110753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.111250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.111806 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.122128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:28.133391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:28.135010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 50/100] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:28.141260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e841d6-e5a0-4a81-bca4-96d77e8c721c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:28.243319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e841d6-e5a0-4a81-bca4-96d77e8c721c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:28.281068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:28.282133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.282623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.283096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.284057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:28.284635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:28.286270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:28.295210 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 51/101] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:28.301199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:28.410949 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2daad-6c01-498d-a9ff-4d36808ed7ee None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:28.449461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603441e1-6e14-4533-a03e-5bc5be2a00cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:28.450728 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603441e1-6e14-4533-a03e-5bc5be2a00cc None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.451227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603441e1-6e14-4533-a03e-5bc5be2a00cc None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.451721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603441e1-6e14-4533-a03e-5bc5be2a00cc None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.453155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603441e1-6e14-4533-a03e-5bc5be2a00cc None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:28.455220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603441e1-6e14-4533-a03e-5bc5be2a00cc None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:28.457145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 51/102] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:28 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:28.462821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:28.476189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ce37-a7ce-4bfe-9190-b134fd86fe8c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.476833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ce37-a7ce-4bfe-9190-b134fd86fe8c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.478840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69ce37-a7ce-4bfe-9190-b134fd86fe8c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.480849 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 52/103] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:28.487408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f105b-703c-4f9a-bab8-5e92578d597d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.488037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f105b-703c-4f9a-bab8-5e92578d597d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.488549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f105b-703c-4f9a-bab8-5e92578d597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.527560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-174f105b-703c-4f9a-bab8-5e92578d597d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:28.529109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-174f105b-703c-4f9a-bab8-5e92578d597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:28.645240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 53/104] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:28.668901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107ee2-b5df-4e7a-9b09-56058d4e2882 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:28.671575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f105b-703c-4f9a-bab8-5e92578d597d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:28.750804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:28.752065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.752576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.753088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.754555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:28.756207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:28.758153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 52/105] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:28 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:28.763870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:28.777323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f105b-703c-4f9a-bab8-5e92578d597d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:28.826858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:28.827682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.827970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.828251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.855767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:28.862783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:28.866181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 54/106] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:28.874321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:28.885044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d6ef-e57e-4a30-98b6-5848d4cf22cb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:28.928424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e18b1-1167-4436-a67a-447e340c5f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:28.929250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e18b1-1167-4436-a67a-447e340c5f55 None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.929532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e18b1-1167-4436-a67a-447e340c5f55 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.929807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e18b1-1167-4436-a67a-447e340c5f55 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8/users/de278bb29838403d8ea329a83f4047be/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.933106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e18b1-1167-4436-a67a-447e340c5f55 None admin] RBAC: Authorizing `identity:create_grant(project_id=982ec084345c45a48babdcb73560bce8, user_id=de278bb29838403d8ea329a83f4047be, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:28.934608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e18b1-1167-4436-a67a-447e340c5f55 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:28.960527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 53/107] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:28 2022] PUT /identity/v3/projects/982ec084345c45a48babdcb73560bce8/users/de278bb29838403d8ea329a83f4047be/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:39:28.961841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84bcf-b744-4f99-955c-5575a4c5f153 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.962155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84bcf-b744-4f99-955c-5575a4c5f153 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.962434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc84bcf-b744-4f99-955c-5575a4c5f153 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:28.964320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 54/108] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:28.979099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67cb6-30c4-4a36-9cc3-a9f265e4a5a3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:28.979444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67cb6-30c4-4a36-9cc3-a9f265e4a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:28.979666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67cb6-30c4-4a36-9cc3-a9f265e4a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.016271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-59b67cb6-30c4-4a36-9cc3-a9f265e4a5a3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:29.017468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-59b67cb6-30c4-4a36-9cc3-a9f265e4a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:29.104155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3b664-a1f4-4e0d-9b7a-047cd89af5fb None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.150409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.151571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.152015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.152443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.153494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:29.153948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:29.156097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:29.160763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 55/109] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:29.163556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9a5d-9314-491b-99e8-6d020f8f4877 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.163875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9a5d-9314-491b-99e8-6d020f8f4877 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.164183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9a5d-9314-491b-99e8-6d020f8f4877 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.166218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 56/110] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:29.167052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 55/111] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:29.171272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d44d9-fe08-4541-a943-a67827d8e308 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.171774 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d44d9-fe08-4541-a943-a67827d8e308 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.172745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:29.173550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d44d9-fe08-4541-a943-a67827d8e308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.205166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d68d44d9-fe08-4541-a943-a67827d8e308 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:29.206600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d68d44d9-fe08-4541-a943-a67827d8e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:29.308589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 57/112] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:29.309466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d44d9-fe08-4541-a943-a67827d8e308 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:29.325067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac98ed9-5189-4ca3-ab6c-627c3d192f6b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.400078 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.400957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.401245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.401521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] PATH_INFO: `/v3/users/bdaa46363cd34630bc53ea00cbbbe37d` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.402918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] RBAC: Authorizing `identity:get_user(user_id=bdaa46363cd34630bc53ea00cbbbe37d)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:29.404398 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:29.406042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 56/113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:29 2022] GET /identity/v3/users/bdaa46363cd34630bc53ea00cbbbe37d => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:29.406826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:29.433182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d44d9-fe08-4541-a943-a67827d8e308 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.519526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.520270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.520554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.520831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.527100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:29.528584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:29.530293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 58/114] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:29.531067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:29.533456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3ddca-0f40-4b3f-a529-fbf7ad88775f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.581755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.583528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.583979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.584431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.596019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:29.605386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:29.607193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 57/115] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:29.608086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:29.661934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f723-facd-423c-bbce-1b0805480832 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.695112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb4b46-220e-49b2-8138-2d09f4981a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.696188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4b46-220e-49b2-8138-2d09f4981a69 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.696619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4b46-220e-49b2-8138-2d09f4981a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.696887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb4b46-220e-49b2-8138-2d09f4981a69 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.698274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb4b46-220e-49b2-8138-2d09f4981a69 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:29.699853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb4b46-220e-49b2-8138-2d09f4981a69 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:29.701685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 59/116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:29 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:29.703072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d47e4-2e6b-4dec-8bf8-fe73a20abd68 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.703511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d47e4-2e6b-4dec-8bf8-fe73a20abd68 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.703939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d47e4-2e6b-4dec-8bf8-fe73a20abd68 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.706039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 60/117] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:29.706947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d47e4-2e6b-4dec-8bf8-fe73a20abd68 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:29.718103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b7ac7-13f4-41e1-992e-569f30c16542 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.750392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775540f-6efb-4203-ae89-987df62807fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.751057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775540f-6efb-4203-ae89-987df62807fe None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.751348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775540f-6efb-4203-ae89-987df62807fe None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.751633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775540f-6efb-4203-ae89-987df62807fe None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.752356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775540f-6efb-4203-ae89-987df62807fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:29.753889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775540f-6efb-4203-ae89-987df62807fe None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:29.779701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 58/118] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:39:29 2022] POST /identity/v3/projects => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:29.781778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce6f5-a374-4528-b116-941b131795f1 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.782246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce6f5-a374-4528-b116-941b131795f1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.782533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce6f5-a374-4528-b116-941b131795f1 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.788476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 59/119] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:29.788476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce6f5-a374-4528-b116-941b131795f1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:29.824808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d47e4-2e6b-4dec-8bf8-fe73a20abd68 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.868078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f96a0-87e2-4f32-a9be-19fafb8046f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.868816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f96a0-87e2-4f32-a9be-19fafb8046f2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.869328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f96a0-87e2-4f32-a9be-19fafb8046f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.869771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f96a0-87e2-4f32-a9be-19fafb8046f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.870828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f96a0-87e2-4f32-a9be-19fafb8046f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:29.871301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f96a0-87e2-4f32-a9be-19fafb8046f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:29.872934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f96a0-87e2-4f32-a9be-19fafb8046f2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:29.883306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 61/120] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:29.890139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28945ec1-b333-4c9b-af41-dedc27b53ba3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.890628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28945ec1-b333-4c9b-af41-dedc27b53ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.891068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28945ec1-b333-4c9b-af41-dedc27b53ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.904511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce6f5-a374-4528-b116-941b131795f1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:29.912502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-28945ec1-b333-4c9b-af41-dedc27b53ba3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:29.914068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-28945ec1-b333-4c9b-af41-dedc27b53ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:29.940728 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea4513-3cbc-47a8-980d-0a7ff9f4f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:29.941628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea4513-3cbc-47a8-980d-0a7ff9f4f8da None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.941957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea4513-3cbc-47a8-980d-0a7ff9f4f8da None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.942270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea4513-3cbc-47a8-980d-0a7ff9f4f8da None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8/users/bdaa46363cd34630bc53ea00cbbbe37d/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.944358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea4513-3cbc-47a8-980d-0a7ff9f4f8da None admin] RBAC: Authorizing `identity:create_grant(project_id=982ec084345c45a48babdcb73560bce8, user_id=bdaa46363cd34630bc53ea00cbbbe37d, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:29.946162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea4513-3cbc-47a8-980d-0a7ff9f4f8da None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:29.968273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 60/121] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:29 2022] PUT /identity/v3/projects/982ec084345c45a48babdcb73560bce8/users/bdaa46363cd34630bc53ea00cbbbe37d/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:29.969813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017b77-80b6-45ed-a0e6-d49b32d241a1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:29.970310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017b77-80b6-45ed-a0e6-d49b32d241a1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:29.970730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d017b77-80b6-45ed-a0e6-d49b32d241a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:29.989689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7d017b77-80b6-45ed-a0e6-d49b32d241a1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:29.991496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7d017b77-80b6-45ed-a0e6-d49b32d241a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:30.006001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 62/122] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:30.007398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28945ec1-b333-4c9b-af41-dedc27b53ba3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.092515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 61/123] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:30.093412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d017b77-80b6-45ed-a0e6-d49b32d241a1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.152708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28945ec1-b333-4c9b-af41-dedc27b53ba3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.193001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.194018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.194569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.194852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] PATH_INFO: `/v3/users/88a37e88de9845eb8e2b6c6158ec9eb5` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.214483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] RBAC: Authorizing `identity:get_user(user_id=88a37e88de9845eb8e2b6c6158ec9eb5)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:30.214972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d017b77-80b6-45ed-a0e6-d49b32d241a1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.215965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:30.217886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 63/124] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/users/88a37e88de9845eb8e2b6c6158ec9eb5 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:30.222951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.249571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.250459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.250748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.251029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.261913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:30.269904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:39:30.271296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 62/125] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:30.272137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.323665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce04df-4f31-4a13-a541-bade495ebfdb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.357435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.358497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.358943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.359374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.370313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:30.374736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b23b-4a2b-49cb-96dd-04826b54da7a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.377812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:30.379467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 64/126] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:30.380591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.408582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.409576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.410038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.410506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.477035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:30.478846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:30.478961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe25a0-9af5-461f-9e04-d99ae96b62fc None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.512100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.513157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.513655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.514171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.515144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:30.515659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:30.517253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:30.525811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 65/127] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:30.527101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.576409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 63/128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:30.577652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.673056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e55f6-a71b-4b0a-8d02-99f463e37282 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.706043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20dc09-c60a-49df-a0b4-036479c97908 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.706690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.707837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.708325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.708794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.710242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:30.711899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:30.714043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 64/129] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:30.715076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.763585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.764379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.764561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.764826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.765590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:30.765898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:30.767366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:30.785327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 66/130] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:30.786013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.814631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fe35b-27f9-46bb-8370-2098b73706f6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:30.849034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:30.850284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:30.850762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:30.851231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:30.852698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:30.854434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:30.856348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 65/131] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:30.857345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:30.957584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc679809-54e9-44de-8fbb-5359b5005860 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:31.009844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:31.012052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48bcc-b499-4741-86d0-2f47e584a46a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:31.013553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.014679 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.015148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.017507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:31.019988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:31.024249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 66/132] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:31.025056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:31.062632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:31.063917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.066760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.067057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.070848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:31.072318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:31.074094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 67/133] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:30 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:31.074966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:31.176441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e84370-0594-409a-9c96-c6c0174f5cb5 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:31.231262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:31.232262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.232768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.233234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.234301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] RBAC: Adding query filter params (role.id=69c9dab1a4b7414a8350c53d4ff261cd, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=88a37e88de9845eb8e2b6c6158ec9eb5) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:31.235836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:31.237779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:31.251257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 67/134] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:31 2022] GET /identity/v3/role_assignments?user.id=88a37e88de9845eb8e2b6c6158ec9eb5&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=69c9dab1a4b7414a8350c53d4ff261cd => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:31.253859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:31.260732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d1fc-050e-4177-851d-19dd91c6f256 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:31.323296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:31.324621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.325104 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.325586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] PATH_INFO: `/v3/projects/4e9f3895b53946e7b2a482005be430e9` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.327162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] RBAC: Authorizing `identity:get_project(project_id=4e9f3895b53946e7b2a482005be430e9)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:31.328896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:31.331302 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 68/135] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:31 2022] GET /identity/v3/projects/4e9f3895b53946e7b2a482005be430e9 => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:31.337140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:31.470690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db4427-904c-408c-91c3-57c3ccf88463 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:31.518721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe73ca0-38ac-4320-9437-d49663a72d71 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:31.532703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30384-e8ca-4a6e-9686-b2a47860d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:31.533618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30384-e8ca-4a6e-9686-b2a47860d7e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.533896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30384-e8ca-4a6e-9686-b2a47860d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.534233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30384-e8ca-4a6e-9686-b2a47860d7e5 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8/users/de278bb29838403d8ea329a83f4047be/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.540590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30384-e8ca-4a6e-9686-b2a47860d7e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=982ec084345c45a48babdcb73560bce8, user_id=de278bb29838403d8ea329a83f4047be, role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:31.542148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30384-e8ca-4a6e-9686-b2a47860d7e5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:31.571705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 68/136] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:31 2022] PUT /identity/v3/projects/982ec084345c45a48babdcb73560bce8/users/de278bb29838403d8ea329a83f4047be/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:31.585768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726f56-584f-49e0-9aef-9ce3eda74430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:31.586748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726f56-584f-49e0-9aef-9ce3eda74430 None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.587019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726f56-584f-49e0-9aef-9ce3eda74430 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.587290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726f56-584f-49e0-9aef-9ce3eda74430 None admin] PATH_INFO: `/v3/projects/4e9f3895b53946e7b2a482005be430e9/users/de278bb29838403d8ea329a83f4047be/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.589407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726f56-584f-49e0-9aef-9ce3eda74430 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e9f3895b53946e7b2a482005be430e9, user_id=de278bb29838403d8ea329a83f4047be, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:31.590955 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726f56-584f-49e0-9aef-9ce3eda74430 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:31.612511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 69/137] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:31 2022] PUT /identity/v3/projects/4e9f3895b53946e7b2a482005be430e9/users/de278bb29838403d8ea329a83f4047be/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:39:31.685277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b07f9-6ca3-4e69-9dc6-f5bd4ffad878 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.685616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b07f9-6ca3-4e69-9dc6-f5bd4ffad878 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.685967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b07f9-6ca3-4e69-9dc6-f5bd4ffad878 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.688360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 69/138] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:31.694717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0fec-2abc-4bf0-a258-73e4ed22cede None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.695001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0fec-2abc-4bf0-a258-73e4ed22cede None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.695273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0fec-2abc-4bf0-a258-73e4ed22cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.714385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-754b0fec-2abc-4bf0-a258-73e4ed22cede None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:31.715649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-754b0fec-2abc-4bf0-a258-73e4ed22cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:31.788328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 70/139] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:31.812490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b07f9-6ca3-4e69-9dc6-f5bd4ffad878 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:31.938397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b07f9-6ca3-4e69-9dc6-f5bd4ffad878 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:31.978254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:31.979074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:31.979359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:31.979660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:31.990380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:31.997318 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:31.998570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 70/140] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:32.004595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0fec-2abc-4bf0-a258-73e4ed22cede None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:32.149606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0fec-2abc-4bf0-a258-73e4ed22cede None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:32.186382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:32.187063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:32.187343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:32.187619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:32.188368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:32.188668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:32.190048 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:32.201568 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 71/141] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:32.207390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:32.371796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9554fc-a21b-40b3-9e0c-b07820281f63 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:32.404753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:32.405984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:32.406484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:32.406949 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:32.408451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:32.410142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:32.411974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 71/142] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:32 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:32.419470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:32.556948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd34ef-eb4c-4be7-8829-0c4d1153a8fe None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:32.599684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:32.600344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:32.600628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:32.600907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:32.682386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:32.683802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:32.789475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 72/143] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:32.794797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:32.946166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34bc10-9bff-4886-ab5e-39b3ae20222f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:32.985591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c75c0-c4de-409b-ace5-1555a5a0b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:32.986638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c75c0-c4de-409b-ace5-1555a5a0b013 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:32.986929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c75c0-c4de-409b-ace5-1555a5a0b013 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:32.987265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c75c0-c4de-409b-ace5-1555a5a0b013 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:32.988530 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c75c0-c4de-409b-ace5-1555a5a0b013 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:32.990000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c75c0-c4de-409b-ace5-1555a5a0b013 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:32.991843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 72/144] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:32 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:32.997900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:33.106373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5191b-cd4c-48cd-9b40-725a9139500a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.106720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5191b-cd4c-48cd-9b40-725a9139500a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.106948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5191b-cd4c-48cd-9b40-725a9139500a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.111023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 73/145] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:33.117258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537caa0c-3b23-4cf7-a9a0-57547c7c226a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.117787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537caa0c-3b23-4cf7-a9a0-57547c7c226a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.117907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537caa0c-3b23-4cf7-a9a0-57547c7c226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.135309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208512-408c-45a1-9619-742ced8281f5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:33.159163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-537caa0c-3b23-4cf7-a9a0-57547c7c226a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:33.160392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-537caa0c-3b23-4cf7-a9a0-57547c7c226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:33.174844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:33.175524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.175811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.176099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.176943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=de278bb29838403d8ea329a83f4047be) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:33.177263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:33.178765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:33.187312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 73/146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:32 2022] GET /identity/v3/role_assignments?user.id=de278bb29838403d8ea329a83f4047be&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=610442154bc84cae961360db5432b95b => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:33.229034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 74/147] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:33.253129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:33.378036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cc272-bc84-4ae2-be62-2382a0df02c2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:33.418013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dec11b-452f-41d5-8a3d-f820533063a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:33.419141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dec11b-452f-41d5-8a3d-f820533063a0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.419595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dec11b-452f-41d5-8a3d-f820533063a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.420034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dec11b-452f-41d5-8a3d-f820533063a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.436522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dec11b-452f-41d5-8a3d-f820533063a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:33.443860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-76dec11b-452f-41d5-8a3d-f820533063a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:33.445260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 74/148] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:33.451307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537caa0c-3b23-4cf7-a9a0-57547c7c226a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:33.536602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818eb72-8c31-4d41-92a7-d539c560241d None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.536867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818eb72-8c31-4d41-92a7-d539c560241d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.537188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818eb72-8c31-4d41-92a7-d539c560241d None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.539139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 75/149] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:33.544491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d991c8d-5468-4afc-b4b5-5c1b703d715f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.544844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d991c8d-5468-4afc-b4b5-5c1b703d715f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.545192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d991c8d-5468-4afc-b4b5-5c1b703d715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.576984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-6d991c8d-5468-4afc-b4b5-5c1b703d715f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:33.579223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6d991c8d-5468-4afc-b4b5-5c1b703d715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:33.607358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537caa0c-3b23-4cf7-a9a0-57547c7c226a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:33.670803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:33.671490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.671773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.672048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.672808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:33.673107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:33.674523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:33.680642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 76/150] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:33.692470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 75/151] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:33.698115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d991c8d-5468-4afc-b4b5-5c1b703d715f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:33.716792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:33.850814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d991c8d-5468-4afc-b4b5-5c1b703d715f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:33.918448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590c15e-af84-408f-9bf0-c52ee27d4799 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:33.921797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:33.923633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.928294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.928817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] PATH_INFO: `/v3/users/bdaa46363cd34630bc53ea00cbbbe37d` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.930292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] RBAC: Authorizing `identity:get_user(user_id=bdaa46363cd34630bc53ea00cbbbe37d)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:33.932203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:33.934059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 77/152] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:33 2022] GET /identity/v3/users/bdaa46363cd34630bc53ea00cbbbe37d => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:33.939570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:33.981945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:33.983493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:33.983964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:33.984473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:33.986003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:33.987893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:33.990496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 76/153] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:33.998890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:34.081613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cd91f-79cf-4cd9-915f-15e4551f892c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:34.118442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:34.119426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.120030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.120517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.197183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:34.199522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:34.260685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e78d1-abea-42b1-9331-ab6c42d90548 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:34.310500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 78/154] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:34.316526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:34.330500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:34.331573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.332049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.332528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.335398 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:34.337057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:34.390749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 77/155] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:39:33 2022] POST /identity/v3/users => generated 283 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:34.452718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc092e6-987b-43e0-84ea-83962f1dcdf2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:34.488716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b3668-8c4f-4547-ab9e-60816927e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:34.489920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3668-8c4f-4547-ab9e-60816927e512 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.490408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3668-8c4f-4547-ab9e-60816927e512 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.490905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3668-8c4f-4547-ab9e-60816927e512 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.492319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b3668-8c4f-4547-ab9e-60816927e512 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:34.494043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b3668-8c4f-4547-ab9e-60816927e512 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:34.496197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 79/156] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:34 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:34.502522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:34.563523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d89c-8555-4abb-aa0f-785a7b6543d0 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.564144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d89c-8555-4abb-aa0f-785a7b6543d0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.564604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d89c-8555-4abb-aa0f-785a7b6543d0 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.566790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 80/157] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:34.575278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c20dc-52ca-4db0-b2a2-f4b83056e9d8 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.575930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c20dc-52ca-4db0-b2a2-f4b83056e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.576422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c20dc-52ca-4db0-b2a2-f4b83056e9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.602410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-678c20dc-52ca-4db0-b2a2-f4b83056e9d8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:34.604923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-678c20dc-52ca-4db0-b2a2-f4b83056e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:34.674142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db64ac7-2fe7-4bdf-85dc-713b19d335e0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:34.695429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 81/158] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:34.717114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:34.718031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c20dc-52ca-4db0-b2a2-f4b83056e9d8 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:34.718369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.718856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.719332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.720360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=bdaa46363cd34630bc53ea00cbbbe37d) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:34.720870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:34.722678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:34.729817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 78/159] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:34 2022] GET /identity/v3/role_assignments?user.id=bdaa46363cd34630bc53ea00cbbbe37d&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:34.836540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c20dc-52ca-4db0-b2a2-f4b83056e9d8 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:34.874564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88023e2e-acfc-4a39-920e-e2f5a9f20ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:34.875387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88023e2e-acfc-4a39-920e-e2f5a9f20ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.875666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88023e2e-acfc-4a39-920e-e2f5a9f20ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.875936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88023e2e-acfc-4a39-920e-e2f5a9f20ff9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.887795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88023e2e-acfc-4a39-920e-e2f5a9f20ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:34.895368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-88023e2e-acfc-4a39-920e-e2f5a9f20ff9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:34.896983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 82/160] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:34.903717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:34.971961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebbb7-b64b-4e92-b1cb-a229a8279a29 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.972234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebbb7-b64b-4e92-b1cb-a229a8279a29 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.972448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ebbb7-b64b-4e92-b1cb-a229a8279a29 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:34.974794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 83/161] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:34.980160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0eb49-e0de-4344-87ef-a16f5e826a4f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:34.980448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0eb49-e0de-4344-87ef-a16f5e826a4f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:34.980745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0eb49-e0de-4344-87ef-a16f5e826a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.002603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-41e0eb49-e0de-4344-87ef-a16f5e826a4f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:35.004148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-41e0eb49-e0de-4344-87ef-a16f5e826a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:35.023462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b892cd-b5cd-4455-98a4-1ff811104c51 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:35.065211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd864ad-fc5c-49a0-afcf-e41644e10e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:35.066330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd864ad-fc5c-49a0-afcf-e41644e10e82 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.066609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd864ad-fc5c-49a0-afcf-e41644e10e82 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.066880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd864ad-fc5c-49a0-afcf-e41644e10e82 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.067636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd864ad-fc5c-49a0-afcf-e41644e10e82 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:35.067939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd864ad-fc5c-49a0-afcf-e41644e10e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:35.069334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd864ad-fc5c-49a0-afcf-e41644e10e82 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:35.079283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 79/162] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:35.082062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cbe3d-7a07-4ea7-9f08-0f56134dacd5 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.082406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cbe3d-7a07-4ea7-9f08-0f56134dacd5 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.082681 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cbe3d-7a07-4ea7-9f08-0f56134dacd5 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.084525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 80/163] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:35.087162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cbe3d-7a07-4ea7-9f08-0f56134dacd5 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.090189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 84/164] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:35.091455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213cb84-f214-4eec-96c4-6bd9e2b8617d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.091741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213cb84-f214-4eec-96c4-6bd9e2b8617d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.092015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213cb84-f214-4eec-96c4-6bd9e2b8617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.112231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7213cb84-f214-4eec-96c4-6bd9e2b8617d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:35.113411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7213cb84-f214-4eec-96c4-6bd9e2b8617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:35.206156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cbe3d-7a07-4ea7-9f08-0f56134dacd5 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:35.206335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 85/165] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:35.207053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213cb84-f214-4eec-96c4-6bd9e2b8617d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.259410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:35.260234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.260515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.260783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] PATH_INFO: `/v3/users/88a37e88de9845eb8e2b6c6158ec9eb5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.262594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] RBAC: Authorizing `identity:get_user(user_id=88a37e88de9845eb8e2b6c6158ec9eb5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:35.264064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:35.265868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 81/166] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:35 2022] GET /identity/v3/users/88a37e88de9845eb8e2b6c6158ec9eb5 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:35.266479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.326522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213cb84-f214-4eec-96c4-6bd9e2b8617d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:35.378792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:35.379935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.380411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.380872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.391388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:35.398903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:35.400667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 86/167] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:35.401616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.424848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1e23-0432-489c-b4c1-b55558e0a60d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:35.500827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6fb5e-657d-4afc-819f-433a91f92554 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:35.514350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:35.515099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.515386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.515851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.535607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:35.536847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.537318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.537776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.539229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:35.540961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:35.541315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:35.543429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 87/168] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:35 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:35.544454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.556376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:39:35.557951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 82/169] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:35.558777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.669861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d44d12-043d-499f-a94a-aaf62f92a300 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:35.694915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231b13-23ea-4f22-8264-27ae7334f27d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:35.705518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:35.706861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.707143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.707416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8/users/88a37e88de9845eb8e2b6c6158ec9eb5/roles/69c9dab1a4b7414a8350c53d4ff261cd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.709689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] RBAC: Authorizing `identity:create_grant(project_id=982ec084345c45a48babdcb73560bce8, user_id=88a37e88de9845eb8e2b6c6158ec9eb5, role_id=69c9dab1a4b7414a8350c53d4ff261cd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:35.711158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:35.733353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 83/170] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:35 2022] PUT /identity/v3/projects/982ec084345c45a48babdcb73560bce8/users/88a37e88de9845eb8e2b6c6158ec9eb5/roles/69c9dab1a4b7414a8350c53d4ff261cd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:35.734197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.773350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:35.773990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:35.774299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:35.774563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:35.775310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:35.775821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:35.777393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:35.800814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 88/171] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:35.806900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:35.959095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b96ef-c592-4c6b-8bae-548b71755f54 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.003498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d46b-d7db-4821-862b-585262fcbb21 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.036125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.036765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.037019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.037295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.038062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:36.038400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.039783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.040522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.041555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.041969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.042394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.043781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.045435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.051258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 89/172] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:35 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:36.053357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:36.054008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 84/173] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:36.069321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:36.161889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e0fa-8bb9-4c3c-8b91-97d58a6b28b3 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.195466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.196359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.196801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.197219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.213424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f6169-13a5-4aea-a907-d7192d3378e7 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.264274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.266306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.266777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.267668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.267945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.268222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] PATH_INFO: `/v3/users/de278bb29838403d8ea329a83f4047be` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.269546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] RBAC: Authorizing `identity:get_user(user_id=de278bb29838403d8ea329a83f4047be)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.271012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.277085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 85/174] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:36 2022] GET /identity/v3/users/de278bb29838403d8ea329a83f4047be => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:36.295240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:36.372275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 90/175] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:36.375320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:36.416237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658e80b-dc2f-4c10-8775-2be3d13dd5cb None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.448483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.449133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.449711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.449711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.472466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258f581-9d06-419d-9963-60daa12ec2f1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.513684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.514934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.515386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.515792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] PATH_INFO: `/v3/projects/4e9f3895b53946e7b2a482005be430e9` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.517287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] RBAC: Authorizing `identity:get_project(project_id=4e9f3895b53946e7b2a482005be430e9)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.519023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.520859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.524927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.525177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 91/176] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:36 2022] GET /identity/v3/projects/4e9f3895b53946e7b2a482005be430e9 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:36.527832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:36.619737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 86/177] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:36.628364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:36.638549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427997-3b66-41ae-8df3-bad467c1ce44 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.698236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.699224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.699640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.700046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.701019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, scope.project.id=4e9f3895b53946e7b2a482005be430e9, user.id=de278bb29838403d8ea329a83f4047be) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:36.701529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.703172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.713923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 92/178] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:36 2022] GET /identity/v3/role_assignments?user.id=de278bb29838403d8ea329a83f4047be&scope.project.id=4e9f3895b53946e7b2a482005be430e9&role.id=610442154bc84cae961360db5432b95b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:36.774057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a603a5-133b-4462-9fee-58d8960934bd None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:36.807546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d498a-b283-456d-94f5-fed97fa07d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:36.808408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d498a-b283-456d-94f5-fed97fa07d84 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:36.808686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d498a-b283-456d-94f5-fed97fa07d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:36.808955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d498a-b283-456d-94f5-fed97fa07d84 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:36.810182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d498a-b283-456d-94f5-fed97fa07d84 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:36.811638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d498a-b283-456d-94f5-fed97fa07d84 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:36.813573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 87/179] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:36 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:36.819290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:36.968412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d26988-ffea-4633-9c65-d9ef04ae7ad1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:37.001340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13c2d8-3d57-4966-b228-b7ea498c8b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:37.002005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c2d8-3d57-4966-b228-b7ea498c8b51 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:37.002313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c2d8-3d57-4966-b228-b7ea498c8b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:37.002586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13c2d8-3d57-4966-b228-b7ea498c8b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:37.003470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c2d8-3d57-4966-b228-b7ea498c8b51 None admin] RBAC: Adding query filter params (role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=de278bb29838403d8ea329a83f4047be) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:37.003780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c2d8-3d57-4966-b228-b7ea498c8b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:37.005241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13c2d8-3d57-4966-b228-b7ea498c8b51 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:37.011551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 93/180] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:36 2022] GET /identity/v3/role_assignments?user.id=de278bb29838403d8ea329a83f4047be&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:38.076641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a5832-3100-4a18-bd0a-d6f05af1a80b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.077146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a5832-3100-4a18-bd0a-d6f05af1a80b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.077217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a5832-3100-4a18-bd0a-d6f05af1a80b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.078980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 88/181] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:38.084561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4a53-422e-4a1f-8e87-b079818e0a28 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.084978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4a53-422e-4a1f-8e87-b079818e0a28 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.085148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4a53-422e-4a1f-8e87-b079818e0a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.102807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-354a4a53-422e-4a1f-8e87-b079818e0a28 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:38.104293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-354a4a53-422e-4a1f-8e87-b079818e0a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:38.112655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ba2b2-0599-4eb6-a77a-0f7a8b3b9c8c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.112940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ba2b2-0599-4eb6-a77a-0f7a8b3b9c8c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.113216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ba2b2-0599-4eb6-a77a-0f7a8b3b9c8c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.115024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 89/182] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:38.120518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d872-2719-4745-98f9-d8ea81ff5d45 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.120801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d872-2719-4745-98f9-d8ea81ff5d45 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.121324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d872-2719-4745-98f9-d8ea81ff5d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.141452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-afe8d872-2719-4745-98f9-d8ea81ff5d45 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:38.143472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-afe8d872-2719-4745-98f9-d8ea81ff5d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:38.179312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 94/183] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:38.202433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4a53-422e-4a1f-8e87-b079818e0a28 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.220023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 90/184] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:38.244163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d872-2719-4745-98f9-d8ea81ff5d45 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.310979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4a53-422e-4a1f-8e87-b079818e0a28 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.340009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d872-2719-4745-98f9-d8ea81ff5d45 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.343470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bcb09-f729-4cdb-8ca3-0c1628dbe7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:38.344483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bcb09-f729-4cdb-8ca3-0c1628dbe7c1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.344947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bcb09-f729-4cdb-8ca3-0c1628dbe7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.345426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bcb09-f729-4cdb-8ca3-0c1628dbe7c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.355300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bcb09-f729-4cdb-8ca3-0c1628dbe7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:38.362358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-7f6bcb09-f729-4cdb-8ca3-0c1628dbe7c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:38.363744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 95/185] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:38.365183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505bcee-9ea1-4006-adfa-f70e82079cf3 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.365585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505bcee-9ea1-4006-adfa-f70e82079cf3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.365999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505bcee-9ea1-4006-adfa-f70e82079cf3 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.367817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 96/186] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:38.369246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505bcee-9ea1-4006-adfa-f70e82079cf3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.378056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad2e12-e220-49c6-b4fe-b9f4945bf437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:38.378987 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2e12-e220-49c6-b4fe-b9f4945bf437 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.379268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2e12-e220-49c6-b4fe-b9f4945bf437 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.379536 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad2e12-e220-49c6-b4fe-b9f4945bf437 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.380695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2e12-e220-49c6-b4fe-b9f4945bf437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:38.382161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad2e12-e220-49c6-b4fe-b9f4945bf437 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:38.384000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 91/187] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:38.389448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b440e75-b09a-4b66-9f4d-34860d003686 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.389733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b440e75-b09a-4b66-9f4d-34860d003686 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.390007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b440e75-b09a-4b66-9f4d-34860d003686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.406487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6b440e75-b09a-4b66-9f4d-34860d003686 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:38.407773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6b440e75-b09a-4b66-9f4d-34860d003686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:38.475051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505bcee-9ea1-4006-adfa-f70e82079cf3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.479441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 92/188] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:38.480421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b440e75-b09a-4b66-9f4d-34860d003686 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.515334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:38.516000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.516283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.516549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.517295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:38.517594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:38.519058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:38.527477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 97/189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:38.532608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.580840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b440e75-b09a-4b66-9f4d-34860d003686 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.616677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:38.617341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.617622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.617910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.618668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:38.620114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:38.625752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a58111-8e75-4081-a86a-27ddf2a2f770 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.641057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 93/190] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:39:38 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:38.641795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.667555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:38.668775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.669198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.669824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.687108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:38.696975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:39:38.698586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 98/191] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:38.706879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.783020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96b8d3-71b7-4a3b-91b5-412f593c57a3 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.819400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3122-bae1-40a4-b51e-480ea7106b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:38.820525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3122-bae1-40a4-b51e-480ea7106b08 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.820945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3122-bae1-40a4-b51e-480ea7106b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.821353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3122-bae1-40a4-b51e-480ea7106b08 None admin] PATH_INFO: `/v3/users/6e5f6db25be0454e90e8cee374895758` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.827806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215354-53a8-45d7-ac2a-f7b5a702018c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.835981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3122-bae1-40a4-b51e-480ea7106b08 None admin] RBAC: Authorizing `identity:get_user(user_id=6e5f6db25be0454e90e8cee374895758)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:38.837447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3122-bae1-40a4-b51e-480ea7106b08 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:38.839512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 94/192] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/users/6e5f6db25be0454e90e8cee374895758 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:38.840819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fd26-9b63-4366-a9a6-bce6274dbb53 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.841106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fd26-9b63-4366-a9a6-bce6274dbb53 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.841381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fd26-9b63-4366-a9a6-bce6274dbb53 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.843046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 95/193] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:38.847151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fd26-9b63-4366-a9a6-bce6274dbb53 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:38.869553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5f1a9-3026-49f6-8e48-e77082aba5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:38.870761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f1a9-3026-49f6-8e48-e77082aba5ca None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.870761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f1a9-3026-49f6-8e48-e77082aba5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.870915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f1a9-3026-49f6-8e48-e77082aba5ca None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.871982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5f1a9-3026-49f6-8e48-e77082aba5ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:38.872297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5f1a9-3026-49f6-8e48-e77082aba5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:38.873849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5f1a9-3026-49f6-8e48-e77082aba5ca None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:38.884272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 99/194] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:38.889838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622383b-8ad1-4096-87fc-56aa4ce4b25d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:38.889838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622383b-8ad1-4096-87fc-56aa4ce4b25d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:38.889838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622383b-8ad1-4096-87fc-56aa4ce4b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:38.904398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8622383b-8ad1-4096-87fc-56aa4ce4b25d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:38.905580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8622383b-8ad1-4096-87fc-56aa4ce4b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:38.968904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fd26-9b63-4366-a9a6-bce6274dbb53 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:38.990021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 100/195] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:38.991002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622383b-8ad1-4096-87fc-56aa4ce4b25d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.013583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.014605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.014882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.015154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.093108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.094591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.095005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622383b-8ad1-4096-87fc-56aa4ce4b25d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.129227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28151d47-b762-438b-87db-8a253f38559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.130131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28151d47-b762-438b-87db-8a253f38559d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.130413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28151d47-b762-438b-87db-8a253f38559d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.130684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28151d47-b762-438b-87db-8a253f38559d None admin] PATH_INFO: `/v3/users/6e5f6db25be0454e90e8cee374895758` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.131887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28151d47-b762-438b-87db-8a253f38559d None admin] RBAC: Authorizing `identity:get_user(user_id=6e5f6db25be0454e90e8cee374895758)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.133338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28151d47-b762-438b-87db-8a253f38559d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.135003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 101/196] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/users/6e5f6db25be0454e90e8cee374895758 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:39.135765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28151d47-b762-438b-87db-8a253f38559d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.191791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 96/197] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:39.192638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.233100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28151d47-b762-438b-87db-8a253f38559d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.272085 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.273180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.273462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.273732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.284440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:39.291539 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:39.292088 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c6554-d499-4a84-9eb4-d0f812f5c069 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.292801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 102/198] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:39.293557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.324985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.325634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.325910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.326209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.390602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.391990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.401269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ae15e-ebfb-4c44-990b-47c9dd49d755 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.433729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.434634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.434917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.435193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.436426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.437893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.439809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 103/199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:39.440464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.506155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 97/200] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:39.507622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.557388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69242-6c4a-470e-af28-520bb9f723a9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.604277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.605736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.606393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.606913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.608007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:39.608451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.610579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.617886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e6f3b-b4d4-45af-b519-2b2e1971c078 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.622170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 104/201] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:39.627233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.654110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.654755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.655038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.655451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.656202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=6e5f6db25be0454e90e8cee374895758) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:39.656714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.658023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.664110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 98/202] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/role_assignments?user.id=6e5f6db25be0454e90e8cee374895758&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:39.664916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.739050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eeaf3-c1c1-4d32-a1be-26204021034c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.775140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.776036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.776312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.776588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.777945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.779516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.781482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 105/203] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:39.787559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.831336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7344a0-c283-4af0-829a-c84c1e56dd05 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.892186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250505a-1264-4f80-bcfb-73b37da17925 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:39.901218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.901218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.901218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.901546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] PATH_INFO: `/v3/users/88a37e88de9845eb8e2b6c6158ec9eb5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.902952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] RBAC: Authorizing `identity:get_user(user_id=88a37e88de9845eb8e2b6c6158ec9eb5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.904748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.906717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 99/204] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/users/88a37e88de9845eb8e2b6c6158ec9eb5 => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:39.916772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:39.945460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:39.946404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:39.946826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:39.947240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:39.948736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] RBAC: Adding query filter params (role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=6e5f6db25be0454e90e8cee374895758) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:39.949197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:39.951661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:39.965096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 106/205] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/role_assignments?user.id=6e5f6db25be0454e90e8cee374895758&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:40.055016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce7ef4-29c5-435b-8a81-57c4a7cafb7d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:40.098657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:40.100021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:40.100446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:40.100868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:40.192719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:40.194604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:40.311450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 100/206] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:40.316818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:40.444642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975901-f6e2-4bbb-acbf-26d2efe5881a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:40.483650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b10f1-d799-42f3-a90b-332ade6c0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:40.484867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b10f1-d799-42f3-a90b-332ade6c0744 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:40.485292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b10f1-d799-42f3-a90b-332ade6c0744 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:40.485706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b10f1-d799-42f3-a90b-332ade6c0744 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:40.490609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b10f1-d799-42f3-a90b-332ade6c0744 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:40.492290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b10f1-d799-42f3-a90b-332ade6c0744 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:40.494603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 107/207] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:40 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:40.500165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:40.607579 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841aef6-85d3-4e3f-b9ba-c6000b62d7f7 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:40.646920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fee8eb-6409-4018-bfce-2a83241679fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:40.647851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fee8eb-6409-4018-bfce-2a83241679fa None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:40.648277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fee8eb-6409-4018-bfce-2a83241679fa None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:40.648692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fee8eb-6409-4018-bfce-2a83241679fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:40.649721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fee8eb-6409-4018-bfce-2a83241679fa None admin] RBAC: Adding query filter params (role.id=69c9dab1a4b7414a8350c53d4ff261cd, scope.project.id=982ec084345c45a48babdcb73560bce8, user.id=88a37e88de9845eb8e2b6c6158ec9eb5) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:40.650240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fee8eb-6409-4018-bfce-2a83241679fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:40.651854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fee8eb-6409-4018-bfce-2a83241679fa None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:40.660895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 101/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:40 2022] GET /identity/v3/role_assignments?user.id=88a37e88de9845eb8e2b6c6158ec9eb5&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=69c9dab1a4b7414a8350c53d4ff261cd => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:41.495225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311333-aad5-49fa-9a25-99fd33007e04 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:41.496262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311333-aad5-49fa-9a25-99fd33007e04 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:41.496760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88311333-aad5-49fa-9a25-99fd33007e04 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:41.499011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 108/209] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:41.504830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6485808-6870-4bc3-b624-404a3bcc4210 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:41.505646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6485808-6870-4bc3-b624-404a3bcc4210 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:41.506143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6485808-6870-4bc3-b624-404a3bcc4210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:41.523191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a6485808-6870-4bc3-b624-404a3bcc4210 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:41.524677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a6485808-6870-4bc3-b624-404a3bcc4210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:41.534913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3a09-a65d-452e-bc12-ab4ad4dcdced None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:41.535469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3a09-a65d-452e-bc12-ab4ad4dcdced None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:41.535950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3a09-a65d-452e-bc12-ab4ad4dcdced None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:41.537916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 109/210] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:41.544273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a539d-d61f-4ef9-834a-83fe08a11d64 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:41.544520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a539d-d61f-4ef9-834a-83fe08a11d64 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:41.544809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a539d-d61f-4ef9-834a-83fe08a11d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:41.566438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-219a539d-d61f-4ef9-834a-83fe08a11d64 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:41.567719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-219a539d-d61f-4ef9-834a-83fe08a11d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:41.604248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 102/211] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:41.628399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6485808-6870-4bc3-b624-404a3bcc4210 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:41.633802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 110/212] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:41.656190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a539d-d61f-4ef9-834a-83fe08a11d64 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:41.726011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6485808-6870-4bc3-b624-404a3bcc4210 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:41.752240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a539d-d61f-4ef9-834a-83fe08a11d64 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:41.759566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:41.760367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:41.760646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:41.760912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:41.762096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:41.763566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:41.765491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 103/213] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:41.770688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:41.792238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:41.793046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:41.793327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:41.793600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:41.803986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:41.811277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:41.812519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 111/214] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:41.826109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:41.886681 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccb8af-79f5-4d56-ba75-4e864e125dc3 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:41.929305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:41.929974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:41.931595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:41.931876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:41.932598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:41.934037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:41.959339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bd4ec-69f4-4466-a23a-40afdd149dd0 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:41.962543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 104/215] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:39:41 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:42.002712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.003825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.004305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.004781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.005766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:42.006286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:42.007996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:42.022611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 112/216] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:42.024718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.133170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dd62b-191f-4b9e-aab5-b1e31d93ac9c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:42.173481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcf274-c653-4416-8d4f-aa351ab69e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.175985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcf274-c653-4416-8d4f-aa351ab69e51 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.175985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcf274-c653-4416-8d4f-aa351ab69e51 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.175985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcf274-c653-4416-8d4f-aa351ab69e51 None admin] PATH_INFO: `/v3/users/8fe1496a1901482f8303c7a09d2bcff4` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.190462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcf274-c653-4416-8d4f-aa351ab69e51 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe1496a1901482f8303c7a09d2bcff4)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:42.191971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcf274-c653-4416-8d4f-aa351ab69e51 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:42.193726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 105/217] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/users/8fe1496a1901482f8303c7a09d2bcff4 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:42.200153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.217311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308a44-765f-4165-b5ca-1472f7fd5e22 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.217647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308a44-765f-4165-b5ca-1472f7fd5e22 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.218102 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84308a44-765f-4165-b5ca-1472f7fd5e22 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.220169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 106/218] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:42.225897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212677c-ac50-4d2f-abd8-3227726ed7ba None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.226278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212677c-ac50-4d2f-abd8-3227726ed7ba None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.226600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212677c-ac50-4d2f-abd8-3227726ed7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.247478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d212677c-ac50-4d2f-abd8-3227726ed7ba None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:42.249518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d212677c-ac50-4d2f-abd8-3227726ed7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:42.328417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9960b38-4b97-4c16-a55c-c0800f5e0fdb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:42.334325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 107/219] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:42.362435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212677c-ac50-4d2f-abd8-3227726ed7ba None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.366394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880a2d-cb3c-4acb-ae98-294e65973d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.367061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880a2d-cb3c-4acb-ae98-294e65973d1c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.367342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880a2d-cb3c-4acb-ae98-294e65973d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.367614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880a2d-cb3c-4acb-ae98-294e65973d1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.445666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880a2d-cb3c-4acb-ae98-294e65973d1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:42.447588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880a2d-cb3c-4acb-ae98-294e65973d1c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:42.491122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212677c-ac50-4d2f-abd8-3227726ed7ba None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:42.529458 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb67bb-e71e-4713-80b0-50944b62c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.530289 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb67bb-e71e-4713-80b0-50944b62c230 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.530573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb67bb-e71e-4713-80b0-50944b62c230 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.530849 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb67bb-e71e-4713-80b0-50944b62c230 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.541821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb67bb-e71e-4713-80b0-50944b62c230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:42.548861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-caeb67bb-e71e-4713-80b0-50944b62c230 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:42.550382 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 108/220] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:42.551673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973d42-9b27-41ad-a5e6-13cec4320dc6 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.551843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973d42-9b27-41ad-a5e6-13cec4320dc6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.552124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973d42-9b27-41ad-a5e6-13cec4320dc6 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.553813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 109/221] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:42.558628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973d42-9b27-41ad-a5e6-13cec4320dc6 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.561712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 113/222] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:42.563495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310978b9-122b-4f82-9ddb-9c4f3e9729cd None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.563938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310978b9-122b-4f82-9ddb-9c4f3e9729cd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.564347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310978b9-122b-4f82-9ddb-9c4f3e9729cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.581645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-310978b9-122b-4f82-9ddb-9c4f3e9729cd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:42.583074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-310978b9-122b-4f82-9ddb-9c4f3e9729cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:42.648388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 114/223] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:42.649467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310978b9-122b-4f82-9ddb-9c4f3e9729cd None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.672402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973d42-9b27-41ad-a5e6-13cec4320dc6 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:42.708309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.709424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.709890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.710326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.711093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:42.711403 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:42.712906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:42.723154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 110/224] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:42.724057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.748170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310978b9-122b-4f82-9ddb-9c4f3e9729cd None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:42.780939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.782160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.782662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.783122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.784508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:42.786213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:42.788407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 115/225] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:42.789340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.825890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ba04b-44d0-42be-a776-423eb0fea02b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:42.859533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.860308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.860601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.860876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.871569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:42.879233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:39:42.880510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 111/226] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:42.881379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.889923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d71738-6241-4e38-8d38-cd6618eece67 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:42.926990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:42.928227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:42.928711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:42.929173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] PATH_INFO: `/v3/users/6e5f6db25be0454e90e8cee374895758` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:42.930583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] RBAC: Authorizing `identity:get_user(user_id=6e5f6db25be0454e90e8cee374895758)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:42.932230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:42.934496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 116/227] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/users/6e5f6db25be0454e90e8cee374895758 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:42.935444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:42.982859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ccf5-e1dd-42fb-94f8-e6239e8651d5 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:43.026340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:43.027300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:43.027713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:43.028118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:43.029425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=8fe1496a1901482f8303c7a09d2bcff4) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:43.029946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:43.032227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:43.035138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8e974-c286-4a58-a20b-216746f3f262 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:43.040921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 112/228] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/role_assignments?user.id=8fe1496a1901482f8303c7a09d2bcff4&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=610442154bc84cae961360db5432b95b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:43.041643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:43.073317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:43.074028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:43.074347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:43.074622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:43.075377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:43.075684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:43.077088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:43.086438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 117/229] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:39:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:43.095238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:43.154642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed641c-908d-450d-87a9-0d8e311b7f4e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:43.201638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:43.202564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:43.202915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:43.203189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:43.205077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:43.206685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:43.208923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 113/230] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:43 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:43.214528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:43.243251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8223f-5491-45f7-a710-d368d5989b1f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:43.282215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:43.283105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:43.283387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:43.283660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] PATH_INFO: `/v3/users/6e5f6db25be0454e90e8cee374895758` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:43.284930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] RBAC: Authorizing `identity:get_user(user_id=6e5f6db25be0454e90e8cee374895758)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:43.286410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:43.289022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 118/231] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:43 2022] GET /identity/v3/users/6e5f6db25be0454e90e8cee374895758 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:43.298854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:43.375155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86ae9-6904-4cbb-97ad-dac149a8df5b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:43.439412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:43.440726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:43.441233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:43.441722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/6e5f6db25be0454e90e8cee374895758/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:43.443986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca6dc7889e0142a289dff26d0208210e, user_id=6e5f6db25be0454e90e8cee374895758, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:43.445668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:43.465585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aa9d0-5c32-4769-8c81-77e1279f7297 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:43.479110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 114/232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:43 2022] PUT /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/6e5f6db25be0454e90e8cee374895758/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:43.517335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b2fdf-b7b1-41b4-b908-6117e57efaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:43.518359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2fdf-b7b1-41b4-b908-6117e57efaa8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:43.518640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2fdf-b7b1-41b4-b908-6117e57efaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:43.518911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2fdf-b7b1-41b4-b908-6117e57efaa8 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:43.522851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b2fdf-b7b1-41b4-b908-6117e57efaa8 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:43.524537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b2fdf-b7b1-41b4-b908-6117e57efaa8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:43.526742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 119/233] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:43 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:43.532733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:43.650114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a88c1-aebf-4114-9712-26090353a253 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:43.682841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25b678-4885-41b5-80b6-60551c27f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:43.683734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b678-4885-41b5-80b6-60551c27f638 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:43.684011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b678-4885-41b5-80b6-60551c27f638 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:43.684280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25b678-4885-41b5-80b6-60551c27f638 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/6e5f6db25be0454e90e8cee374895758/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:43.686534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b678-4885-41b5-80b6-60551c27f638 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca6dc7889e0142a289dff26d0208210e, user_id=6e5f6db25be0454e90e8cee374895758, role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:43.688136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25b678-4885-41b5-80b6-60551c27f638 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:43.704358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 115/234] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:43 2022] PUT /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/6e5f6db25be0454e90e8cee374895758/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:44.867215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74efe24-85df-45f6-bd10-0902ed043edb None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:44.868214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74efe24-85df-45f6-bd10-0902ed043edb None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:44.868708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74efe24-85df-45f6-bd10-0902ed043edb None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:44.872777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 120/235] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:44.877982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7b97-d8f1-4b0f-af1b-45efadfdd323 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:44.878816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7b97-d8f1-4b0f-af1b-45efadfdd323 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:44.879331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7b97-d8f1-4b0f-af1b-45efadfdd323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:44.904125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7e2d7b97-d8f1-4b0f-af1b-45efadfdd323 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:44.905325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7e2d7b97-d8f1-4b0f-af1b-45efadfdd323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:44.936765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fbbae-1da5-475a-8890-567585b11c57 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:44.937373 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fbbae-1da5-475a-8890-567585b11c57 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:44.937834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fbbae-1da5-475a-8890-567585b11c57 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:44.940156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 121/236] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:44.945183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641761a-73d2-44de-bf0c-d220a498c891 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:44.945691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641761a-73d2-44de-bf0c-d220a498c891 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:44.946335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641761a-73d2-44de-bf0c-d220a498c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:44.963757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b641761a-73d2-44de-bf0c-d220a498c891 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:44.965277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b641761a-73d2-44de-bf0c-d220a498c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:45.002846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 116/237] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:45.036621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 122/238] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:45.040992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7b97-d8f1-4b0f-af1b-45efadfdd323 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:45.061319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641761a-73d2-44de-bf0c-d220a498c891 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:45.158548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641761a-73d2-44de-bf0c-d220a498c891 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:45.194176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:45.195351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.195847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.196304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.197664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:45.199318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:45.201141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 123/239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:45.207009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:45.292232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7b97-d8f1-4b0f-af1b-45efadfdd323 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:45.313327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f05d1-2ba9-436d-9c41-cd6e40e177a1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:45.350152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:45.351714 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.352205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.352780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.354556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:45.356895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:45.373623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:45.374850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.375394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.375873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.387816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 124/240] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:39:45 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:45.400485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:45.417265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:45.418878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 117/241] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:45.424978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:45.530603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0029f-eb1d-4fef-824b-4213a137b4af None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:45.566438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:45.567479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.567979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.568461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.569440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:45.569961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:45.571601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:45.581636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 125/242] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:45.586970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:45.705062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62675e3-3689-423a-bf53-3abf93f5f954 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:45.739576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a839c-4aa0-4f06-a646-18fe75108027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:45.740808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a839c-4aa0-4f06-a646-18fe75108027 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.741278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a839c-4aa0-4f06-a646-18fe75108027 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.741758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a839c-4aa0-4f06-a646-18fe75108027 None admin] PATH_INFO: `/v3/users/4f4dcdd058af4b0f9df442b23f84beea` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.756544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a839c-4aa0-4f06-a646-18fe75108027 None admin] RBAC: Authorizing `identity:get_user(user_id=4f4dcdd058af4b0f9df442b23f84beea)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:45.758342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a839c-4aa0-4f06-a646-18fe75108027 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:45.760580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 118/243] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:45 2022] GET /identity/v3/users/4f4dcdd058af4b0f9df442b23f84beea => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:45.765844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:45.867415 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10781bd8-fadf-4e42-8862-5e07360616d7 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:45.896992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6490cf-4cb2-4ab1-bf5a-58bc19305085 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.897940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6490cf-4cb2-4ab1-bf5a-58bc19305085 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.898540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6490cf-4cb2-4ab1-bf5a-58bc19305085 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.900907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 119/244] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:45.903101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:45.903946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.904364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.904772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.907592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c008-9ab0-4454-a332-f915731a4271 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:45.908040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c008-9ab0-4454-a332-f915731a4271 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:45.908452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c008-9ab0-4454-a332-f915731a4271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:45.925682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3351c008-9ab0-4454-a332-f915731a4271 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:45.926945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3351c008-9ab0-4454-a332-f915731a4271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:45.971549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:45.972581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:46.000845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 120/245] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:46.020314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c008-9ab0-4454-a332-f915731a4271 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.078168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 126/246] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:46.084888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.139314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c008-9ab0-4454-a332-f915731a4271 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.181916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.182791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.183077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.183351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.200147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:46.203892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98b94a-42bb-432c-a0e6-8b1439f2ebcb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.209250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:46.211105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 121/247] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:46.223936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.247231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.248314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.248785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.249898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.252782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:46.256228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:46.261486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 127/248] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:46 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:46.267746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.335006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f547ce-9b46-479b-859d-dcb7f28d5511 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.378020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.378841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.379479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.379828 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.380660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] RBAC: Adding query filter params (name=member) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:46.381035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:46.383067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:46.394165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 122/249] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:46.396716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3292d-ea82-4a79-8cf1-3f9f5f45ef64 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.399700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.436754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4b4c4-7114-4ea4-bd52-7e123def202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.437424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4b4c4-7114-4ea4-bd52-7e123def202e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.437701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4b4c4-7114-4ea4-bd52-7e123def202e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.437972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4b4c4-7114-4ea4-bd52-7e123def202e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.441571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4b4c4-7114-4ea4-bd52-7e123def202e None admin] RBAC: Adding query filter params (role.id=69c9dab1a4b7414a8350c53d4ff261cd, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=4f4dcdd058af4b0f9df442b23f84beea) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:46.441571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4b4c4-7114-4ea4-bd52-7e123def202e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:46.441571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4b4c4-7114-4ea4-bd52-7e123def202e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:46.449909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 128/250] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:46 2022] GET /identity/v3/role_assignments?user.id=4f4dcdd058af4b0f9df442b23f84beea&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=69c9dab1a4b7414a8350c53d4ff261cd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:46.451205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bab05-f38c-4bcc-981f-cb3541f13d36 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.451469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bab05-f38c-4bcc-981f-cb3541f13d36 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.451738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bab05-f38c-4bcc-981f-cb3541f13d36 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.453498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 129/251] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:46.462048 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3781-bde5-4fb3-8ce4-71acb6f9f27c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.463479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3781-bde5-4fb3-8ce4-71acb6f9f27c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.463602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3781-bde5-4fb3-8ce4-71acb6f9f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.495576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f17a3781-bde5-4fb3-8ce4-71acb6f9f27c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:46.500009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f17a3781-bde5-4fb3-8ce4-71acb6f9f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:46.558196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca82d9-2984-4c8e-9900-930cb250fb5d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.603203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 130/252] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:46.620805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.621741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.622022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.622329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] PATH_INFO: `/v3/users/8fe1496a1901482f8303c7a09d2bcff4` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.624724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] RBAC: Authorizing `identity:get_user(user_id=8fe1496a1901482f8303c7a09d2bcff4)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:46.626246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:46.628341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 123/253] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:46 2022] GET /identity/v3/users/8fe1496a1901482f8303c7a09d2bcff4 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:46.629010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3781-bde5-4fb3-8ce4-71acb6f9f27c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.634353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.782413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f745-109a-4252-ad16-39970f172b9c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.821838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1465-d7e3-4a0b-b1d8-ec917a7434f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.823015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1465-d7e3-4a0b-b1d8-ec917a7434f0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.823434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1465-d7e3-4a0b-b1d8-ec917a7434f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.823915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1465-d7e3-4a0b-b1d8-ec917a7434f0 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.825223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1465-d7e3-4a0b-b1d8-ec917a7434f0 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:46.826817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1465-d7e3-4a0b-b1d8-ec917a7434f0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:46.828647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 124/254] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:46 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:46.834407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982ce28-23ab-46eb-8b88-3f8665f92370 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.834953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982ce28-23ab-46eb-8b88-3f8665f92370 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.835416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982ce28-23ab-46eb-8b88-3f8665f92370 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.837576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 125/255] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:46.840041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982ce28-23ab-46eb-8b88-3f8665f92370 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:46.853245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a3781-bde5-4fb3-8ce4-71acb6f9f27c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.892782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1324551-b27d-4e6e-8f32-9acc780a7f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.894409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324551-b27d-4e6e-8f32-9acc780a7f2d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.894881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324551-b27d-4e6e-8f32-9acc780a7f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.895318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324551-b27d-4e6e-8f32-9acc780a7f2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.911556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1324551-b27d-4e6e-8f32-9acc780a7f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:46.919348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f1324551-b27d-4e6e-8f32-9acc780a7f2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:39:46.920734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 131/256] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:39:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:46.922064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa766b8-91b8-4495-9c78-6c81c89eb619 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.926665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa766b8-91b8-4495-9c78-6c81c89eb619 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.927112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa766b8-91b8-4495-9c78-6c81c89eb619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.944616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2fa766b8-91b8-4495-9c78-6c81c89eb619 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:46.946156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2fa766b8-91b8-4495-9c78-6c81c89eb619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:46.946595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982ce28-23ab-46eb-8b88-3f8665f92370 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:46.980167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:46.981163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:46.981511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:46.981852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/8fe1496a1901482f8303c7a09d2bcff4/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:46.984102 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca6dc7889e0142a289dff26d0208210e, user_id=8fe1496a1901482f8303c7a09d2bcff4, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:46.985547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:47.010633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 126/257] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:46 2022] PUT /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/8fe1496a1901482f8303c7a09d2bcff4/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:47.011263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.015299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 132/258] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:47.049389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa766b8-91b8-4495-9c78-6c81c89eb619 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.163829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa766b8-91b8-4495-9c78-6c81c89eb619 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:47.199176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:47.200481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:47.200960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:47.201417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:47.212993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:47.221345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:39:47.223003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 133/259] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:47.231135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.261949 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b343f3-b60a-42d5-a63d-a92683672834 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:47.341793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c001a3-f084-451b-b2a0-75bea1cfdcae None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:47.363424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:47.364534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:47.364534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:47.364709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:47.365401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:47.365706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:47.367157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:47.380376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:47.381469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:47.381959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:47.382442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:47.383693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:47.384186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:47.385290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 127/260] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:47.386009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:47.399882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 134/261] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:47.406214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.407468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.517954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e54e-9bc6-4e7e-85c5-b58f39fce1cc None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:47.553444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:47.554686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:47.555180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:47.555648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] PATH_INFO: `/v3/users/6e5f6db25be0454e90e8cee374895758` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:47.557037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] RBAC: Authorizing `identity:get_user(user_id=6e5f6db25be0454e90e8cee374895758)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:47.558852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:47.560895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 135/262] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/users/6e5f6db25be0454e90e8cee374895758 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:47.567452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.628848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6f08a-db49-497e-bfc2-73130a5106ed None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:47.673468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cade4d-5198-40e2-97e4-925f51bb9592 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:47.706923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:47.707774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:47.708060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:47.708334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] PATH_INFO: `/v3/users/6e5f6db25be0454e90e8cee374895758` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:47.709539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] RBAC: Authorizing `identity:get_user(user_id=6e5f6db25be0454e90e8cee374895758)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:47.709872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:47.710773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:47.711028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:47.711440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:47.711894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:47.712983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 128/263] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/users/6e5f6db25be0454e90e8cee374895758 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:47.735383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.787247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:47.789520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:47.903706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 136/264] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:47.909805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:47.958527 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f4132-73fe-4a85-91ca-17d2eb207d1a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:48.008090 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f488-4ffd-4aa3-9ca2-a2e700f8622d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:48.014796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:48.015474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:48.015758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:48.016038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:48.042127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:48.043337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:48.043803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:48.044282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:48.045648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:48.047301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:48.049545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 137/265] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:48.055335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:48.101516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:48.103025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:48.150572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663400b-60b6-4bb9-9e0e-5b604516c048 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:48.197524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:48.198555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:48.199042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:48.199503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:48.200513 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=6e5f6db25be0454e90e8cee374895758) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:48.201016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:48.202665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:48.207463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 129/266] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:48.212785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:48.214064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 138/267] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:48 2022] GET /identity/v3/role_assignments?user.id=6e5f6db25be0454e90e8cee374895758&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:48.327801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc911fd-dd28-432f-87ab-e47b8c3b80e9 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:48.369619 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd957f72-9ad4-4d15-8a26-67005e869d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:48.370880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd957f72-9ad4-4d15-8a26-67005e869d0a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:48.371338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd957f72-9ad4-4d15-8a26-67005e869d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:48.371800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd957f72-9ad4-4d15-8a26-67005e869d0a None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:48.373223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd957f72-9ad4-4d15-8a26-67005e869d0a None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:48.374906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd957f72-9ad4-4d15-8a26-67005e869d0a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:48.376887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 130/268] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:48 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:48.383249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:48.500103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ffed-616a-401d-a880-09b699e5beaf None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:48.540392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fd573-9706-449e-8cb7-29775f8442e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:48.541051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd573-9706-449e-8cb7-29775f8442e2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:48.541348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd573-9706-449e-8cb7-29775f8442e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:48.541582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd573-9706-449e-8cb7-29775f8442e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:48.542441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fd573-9706-449e-8cb7-29775f8442e2 None admin] RBAC: Adding query filter params (role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=6e5f6db25be0454e90e8cee374895758) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:48.542747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fd573-9706-449e-8cb7-29775f8442e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:48.544193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fd573-9706-449e-8cb7-29775f8442e2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:48.556566 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 139/269] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:48 2022] GET /identity/v3/role_assignments?user.id=6e5f6db25be0454e90e8cee374895758&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:49.096959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb627c-4740-4b42-8d70-faa1a6fef3e3 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.096959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb627c-4740-4b42-8d70-faa1a6fef3e3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.096959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb627c-4740-4b42-8d70-faa1a6fef3e3 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.096959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 131/270] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:49.102475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bb68-f230-40de-a735-f290104d2cce None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.103257 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bb68-f230-40de-a735-f290104d2cce None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.103721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bb68-f230-40de-a735-f290104d2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.122642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c111bb68-f230-40de-a735-f290104d2cce None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:49.124070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c111bb68-f230-40de-a735-f290104d2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:49.214644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 140/271] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:49.241239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb627c-4740-4b42-8d70-faa1a6fef3e3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:49.354618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb627c-4740-4b42-8d70-faa1a6fef3e3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:49.390066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f348b7-8d6e-46bf-97cf-fbda97f05323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:49.390931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f348b7-8d6e-46bf-97cf-fbda97f05323 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.391213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f348b7-8d6e-46bf-97cf-fbda97f05323 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.391489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f348b7-8d6e-46bf-97cf-fbda97f05323 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.392764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f348b7-8d6e-46bf-97cf-fbda97f05323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:49.394449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f348b7-8d6e-46bf-97cf-fbda97f05323 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:49.396562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 132/272] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:49.402166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111bb68-f230-40de-a735-f290104d2cce None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:49.503875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111bb68-f230-40de-a735-f290104d2cce None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:49.528473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe1ed-96e7-42a5-8d39-13e57af0183e None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.528763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe1ed-96e7-42a5-8d39-13e57af0183e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.529023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fe1ed-96e7-42a5-8d39-13e57af0183e None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.531054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 133/273] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:49.535970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbbd60-9c6d-472c-8e9b-22be564c9745 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.536257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbbd60-9c6d-472c-8e9b-22be564c9745 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.536584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbbd60-9c6d-472c-8e9b-22be564c9745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.537688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:49.538407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.538689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.538963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.539685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:49.541135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:49.554007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-00cbbd60-9c6d-472c-8e9b-22be564c9745 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:49.556456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-00cbbd60-9c6d-472c-8e9b-22be564c9745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:49.565481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 141/274] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:39:49 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:49.638436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 134/275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:49.662393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:49.744397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2abed-2008-4ff5-85de-6f1fbcaad629 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.744726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2abed-2008-4ff5-85de-6f1fbcaad629 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.745028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2abed-2008-4ff5-85de-6f1fbcaad629 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.747110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 135/276] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:49.756372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1060-0751-41f2-b2aa-93103ccd61ee None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.756372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1060-0751-41f2-b2aa-93103ccd61ee None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.756372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c1060-0751-41f2-b2aa-93103ccd61ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.771760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1dcaa-09dc-4d2b-b5ec-e7a71e945364 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:49.774490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-966c1060-0751-41f2-b2aa-93103ccd61ee None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:49.775670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-966c1060-0751-41f2-b2aa-93103ccd61ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:49.818331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:49.819212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:49.819498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:49.819775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:49.836418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:49.843529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:49.844936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 142/277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:49.850780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:49.859829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 136/278] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:49.885019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c1060-0751-41f2-b2aa-93103ccd61ee None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:49.965080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90297aa-1af2-470b-83fb-931f3e4c6065 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:49.998749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:49.999830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.000214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.000490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.001238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:50.001543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.003017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.013734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 143/279] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:50.019124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.025200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c1060-0751-41f2-b2aa-93103ccd61ee None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.075900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.076695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.076972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.077243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.097924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:50.117377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:50.118655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 137/280] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:50.125429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.168186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1525b6-4a6e-47ac-a9aa-2596f8a3a46b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.203052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057612c-7889-4659-99c7-5b617632adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.204372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057612c-7889-4659-99c7-5b617632adcb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.205173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057612c-7889-4659-99c7-5b617632adcb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.205696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057612c-7889-4659-99c7-5b617632adcb None admin] PATH_INFO: `/v3/users/f383c605dcd24ce5a90f500b94caeb6b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.219493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057612c-7889-4659-99c7-5b617632adcb None admin] RBAC: Authorizing `identity:get_user(user_id=f383c605dcd24ce5a90f500b94caeb6b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.221356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057612c-7889-4659-99c7-5b617632adcb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.223674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 144/281] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/users/f383c605dcd24ce5a90f500b94caeb6b => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:50.228750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498aeb-9ef5-4a36-8d3a-12292d8e24f0 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.229203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498aeb-9ef5-4a36-8d3a-12292d8e24f0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.229613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498aeb-9ef5-4a36-8d3a-12292d8e24f0 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.231709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 145/282] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:50.232530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498aeb-9ef5-4a36-8d3a-12292d8e24f0 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.293574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b199c6-6689-4dcf-bcdb-21cce109f85c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.330292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d426b-c129-4ddf-b569-a6e0839cb8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.331330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d426b-c129-4ddf-b569-a6e0839cb8c1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.331801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d426b-c129-4ddf-b569-a6e0839cb8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.332296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d426b-c129-4ddf-b569-a6e0839cb8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.333226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d426b-c129-4ddf-b569-a6e0839cb8c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:50.333617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498aeb-9ef5-4a36-8d3a-12292d8e24f0 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.333924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d426b-c129-4ddf-b569-a6e0839cb8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.335503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d426b-c129-4ddf-b569-a6e0839cb8c1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.344148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 138/283] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:50.345709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cbb8-23fe-402b-9e0b-80637882f4f8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.346241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cbb8-23fe-402b-9e0b-80637882f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.346705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8cbb8-23fe-402b-9e0b-80637882f4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.363293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a0f8cbb8-23fe-402b-9e0b-80637882f4f8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:50.364722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a0f8cbb8-23fe-402b-9e0b-80637882f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:50.371828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.372472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.372901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.373308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.374327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, user.id=f383c605dcd24ce5a90f500b94caeb6b, scope.system=all) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:50.374789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.376405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.381892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 146/284] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/role_assignments?user.id=f383c605dcd24ce5a90f500b94caeb6b&scope.system=all&role.id=610442154bc84cae961360db5432b95b => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:50.383046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.441878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 139/285] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:50.471026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8cbb8-23fe-402b-9e0b-80637882f4f8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.511077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f623-de04-4ed9-b3ed-937b0e1a6a6e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.589683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.590616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.590898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.591171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] PATH_INFO: `/v3/users/4f4dcdd058af4b0f9df442b23f84beea` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.592447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] RBAC: Authorizing `identity:get_user(user_id=4f4dcdd058af4b0f9df442b23f84beea)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.593940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.595883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 147/286] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/users/4f4dcdd058af4b0f9df442b23f84beea => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:50.601342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.620344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8cbb8-23fe-402b-9e0b-80637882f4f8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.653087 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.653881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.654188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.654464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.665850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:50.673660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:50.675573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 140/287] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:50.681052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.791335 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d67ca-6ba7-4786-849f-877ffdb720e5 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.805676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c73e8b-8d8b-4637-90c7-0b74701364e8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.827676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.828349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.828631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.829149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.830250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] RBAC: Adding query filter params (name=member) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:50.830590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.834122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.841310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 141/288] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:50.846882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.884949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.886239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.886732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.887188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.894857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.896552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.904283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 148/289] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:50.910127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:50.952097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca21f47-2cd2-42c3-8a2f-c85363e68d05 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:50.990333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:50.991211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:50.991846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:50.992123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] PATH_INFO: `/v3/users/8fe1496a1901482f8303c7a09d2bcff4` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:50.993485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe1496a1901482f8303c7a09d2bcff4)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:50.994984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:50.996954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 142/290] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:50 2022] GET /identity/v3/users/8fe1496a1901482f8303c7a09d2bcff4 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:51.002252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:51.104631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e165715-6d2d-4790-aef3-a3f5975bd707 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:51.125031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab81e0-d6e9-4d01-af27-25b8d93dcd99 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:51.144492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:51.145589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:51.145875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:51.146188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:51.158406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:51.159347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:51.159625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:51.159892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/4f4dcdd058af4b0f9df442b23f84beea/roles/69c9dab1a4b7414a8350c53d4ff261cd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:51.161935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] RBAC: Authorizing `identity:create_grant(project_id=ca6dc7889e0142a289dff26d0208210e, user_id=4f4dcdd058af4b0f9df442b23f84beea, role_id=69c9dab1a4b7414a8350c53d4ff261cd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:51.163410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:51.179997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 149/291] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:39:50 2022] PUT /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e/users/4f4dcdd058af4b0f9df442b23f84beea/roles/69c9dab1a4b7414a8350c53d4ff261cd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:39:51.222346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:51.223912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:51.327701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 143/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 24 14:39:51.333630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:51.436359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953eeee-6b00-4eb4-91c1-db6145235d7d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:51.469988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1098e-2c3e-448b-8eed-6c48650ab1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:51.470887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1098e-2c3e-448b-8eed-6c48650ab1e2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:51.471225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1098e-2c3e-448b-8eed-6c48650ab1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:51.471500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1098e-2c3e-448b-8eed-6c48650ab1e2 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:51.472670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1098e-2c3e-448b-8eed-6c48650ab1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:51.474118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1098e-2c3e-448b-8eed-6c48650ab1e2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:51.475983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 150/293] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:51 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:51.481775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:51.577505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f903bc-f245-4816-b4d8-728a00b9bc07 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:51.611075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f25dc-51ed-4fb6-a35c-fa39a2c346d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:51.611759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f25dc-51ed-4fb6-a35c-fa39a2c346d5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:51.612040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f25dc-51ed-4fb6-a35c-fa39a2c346d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:51.612313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f25dc-51ed-4fb6-a35c-fa39a2c346d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:51.613137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f25dc-51ed-4fb6-a35c-fa39a2c346d5 None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=8fe1496a1901482f8303c7a09d2bcff4) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:51.613442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f25dc-51ed-4fb6-a35c-fa39a2c346d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:51.614899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f25dc-51ed-4fb6-a35c-fa39a2c346d5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:51.621099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 144/294] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:51 2022] GET /identity/v3/role_assignments?user.id=8fe1496a1901482f8303c7a09d2bcff4&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=610442154bc84cae961360db5432b95b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:52.210371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cad7-1e18-4e0d-ac08-6149b523213d None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.211036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cad7-1e18-4e0d-ac08-6149b523213d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.211036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982cad7-1e18-4e0d-ac08-6149b523213d None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.212628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 151/295] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:52.218263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ba5d-9128-4309-be04-ddfa345ceb76 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.219129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ba5d-9128-4309-be04-ddfa345ceb76 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.219603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22ba5d-9128-4309-be04-ddfa345ceb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.240072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-fe22ba5d-9128-4309-be04-ddfa345ceb76 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:52.241572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fe22ba5d-9128-4309-be04-ddfa345ceb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:52.316121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 145/296] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:52.339514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982cad7-1e18-4e0d-ac08-6149b523213d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:52.444529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982cad7-1e18-4e0d-ac08-6149b523213d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:52.478880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f404d58-8fab-4c27-9288-081a40f16d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:52.480057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404d58-8fab-4c27-9288-081a40f16d84 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.480554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404d58-8fab-4c27-9288-081a40f16d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.481022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f404d58-8fab-4c27-9288-081a40f16d84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.491457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f404d58-8fab-4c27-9288-081a40f16d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:52.498733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-5f404d58-8fab-4c27-9288-081a40f16d84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:52.505033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 152/297] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:52.506715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ba5d-9128-4309-be04-ddfa345ceb76 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:52.559510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef987c-23bc-43a5-9af1-0bf7e31417e9 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.560145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef987c-23bc-43a5-9af1-0bf7e31417e9 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.560622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef987c-23bc-43a5-9af1-0bf7e31417e9 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.562647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 153/298] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:52.568874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845157-8b26-43df-888b-4134d4e69aae None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.569421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845157-8b26-43df-888b-4134d4e69aae None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.569890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845157-8b26-43df-888b-4134d4e69aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.587563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-45845157-8b26-43df-888b-4134d4e69aae None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:52.589197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-45845157-8b26-43df-888b-4134d4e69aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:52.610951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22ba5d-9128-4309-be04-ddfa345ceb76 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:52.644957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:52.645654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.645971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.646277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.647033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:52.647348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:52.648717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:52.657331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 146/299] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:52.661850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 154/300] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:52.663550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:52.689721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845157-8b26-43df-888b-4134d4e69aae None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:52.771687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e96f9-43a8-4ad3-88b0-cef750582b51 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:52.792705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845157-8b26-43df-888b-4134d4e69aae None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:52.804108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:52.805206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.805628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.806065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] PATH_INFO: `/v3/users/624758b382114174a8b29fd479e77c83` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.819760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] RBAC: Authorizing `identity:get_user(user_id=624758b382114174a8b29fd479e77c83)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:52.821467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:52.828215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 147/301] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:52 2022] GET /identity/v3/users/624758b382114174a8b29fd479e77c83 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:52.830342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:52.833220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:52.834930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.835213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.835487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.839028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:52.841528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:52.844214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 155/302] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:52.850575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:52.938519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bfae5-f36c-4232-84c8-1e8840edfe90 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:52.951801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36291f9b-8b62-4632-993a-c8a8b84d2c5f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:52.972022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb940e4-dea6-4e65-9487-688ec1cf1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:52.972691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb940e4-dea6-4e65-9487-688ec1cf1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.973135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb940e4-dea6-4e65-9487-688ec1cf1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.973307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb940e4-dea6-4e65-9487-688ec1cf1dd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.974147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb940e4-dea6-4e65-9487-688ec1cf1dd6 None admin] RBAC: Adding query filter params (role.id=69c9dab1a4b7414a8350c53d4ff261cd, user.id=624758b382114174a8b29fd479e77c83, scope.system=all) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:52.974467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb940e4-dea6-4e65-9487-688ec1cf1dd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:52.975908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb940e4-dea6-4e65-9487-688ec1cf1dd6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:52.981247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 148/303] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Mar 24 14:39:52 2022] GET /identity/v3/role_assignments?user.id=624758b382114174a8b29fd479e77c83&scope.system=all&role.id=69c9dab1a4b7414a8350c53d4ff261cd => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:52.990177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c7a9-bc3d-48e1-a7d1-e00017a3ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:52.991316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c7a9-bc3d-48e1-a7d1-e00017a3ab5e None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:52.991816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c7a9-bc3d-48e1-a7d1-e00017a3ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:52.992282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c7a9-bc3d-48e1-a7d1-e00017a3ab5e None admin] PATH_INFO: `/v3/groups` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:52.993225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c7a9-bc3d-48e1-a7d1-e00017a3ab5e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:52.994981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c7a9-bc3d-48e1-a7d1-e00017a3ab5e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:53.013277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 156/304] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Mar 24 14:39:52 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:39:53.221346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab03a9-9b81-4f74-8c85-047cb9beece7 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.221865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab03a9-9b81-4f74-8c85-047cb9beece7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.221865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab03a9-9b81-4f74-8c85-047cb9beece7 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.223784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 149/305] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:53.229350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a22b-f465-4806-b67b-ea4197c166e9 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.229802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a22b-f465-4806-b67b-ea4197c166e9 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.229913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a22b-f465-4806-b67b-ea4197c166e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.250008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3f34a22b-f465-4806-b67b-ea4197c166e9 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:53.251269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3f34a22b-f465-4806-b67b-ea4197c166e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:53.316000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 157/306] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:53.338554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab03a9-9b81-4f74-8c85-047cb9beece7 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:53.441862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab03a9-9b81-4f74-8c85-047cb9beece7 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:53.476103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:53.476826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.477103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.477377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.487585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:53.494564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:53.495764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 150/307] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:53.501553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a22b-f465-4806-b67b-ea4197c166e9 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:53.594719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a22b-f465-4806-b67b-ea4197c166e9 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:53.627701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eb7bd-7a4d-4d19-a2e4-4a6faa5b96f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:53.628732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb7bd-7a4d-4d19-a2e4-4a6faa5b96f3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.629218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb7bd-7a4d-4d19-a2e4-4a6faa5b96f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.629676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb7bd-7a4d-4d19-a2e4-4a6faa5b96f3 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.630634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eb7bd-7a4d-4d19-a2e4-4a6faa5b96f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:53.631127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eb7bd-7a4d-4d19-a2e4-4a6faa5b96f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:53.632943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eb7bd-7a4d-4d19-a2e4-4a6faa5b96f3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:53.641284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 158/308] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:53.647043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:53.745884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2ccd5-bd8f-424b-990e-9e4ec1540eef None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:53.774858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96ac8-4bed-4529-9131-a0fdc8c5041c None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.775461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96ac8-4bed-4529-9131-a0fdc8c5041c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.776084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96ac8-4bed-4529-9131-a0fdc8c5041c None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.778840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 159/309] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:53.779699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:53.780786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.781271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.781726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] PATH_INFO: `/v3/users/f383c605dcd24ce5a90f500b94caeb6b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.783700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dec6a-2cf4-42d2-b93d-e441092dd7bd None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.783977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dec6a-2cf4-42d2-b93d-e441092dd7bd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.784246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dec6a-2cf4-42d2-b93d-e441092dd7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.786213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] RBAC: Authorizing `identity:get_user(user_id=f383c605dcd24ce5a90f500b94caeb6b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:53.787872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:53.789860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 151/310] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:53 2022] GET /identity/v3/users/f383c605dcd24ce5a90f500b94caeb6b => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:53.796138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:53.809868 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-536dec6a-2cf4-42d2-b93d-e441092dd7bd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:53.809868 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-536dec6a-2cf4-42d2-b93d-e441092dd7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:53.877157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 160/311] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:53.905989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dec6a-2cf4-42d2-b93d-e441092dd7bd None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:53.912728 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff158b10-1867-4f10-84bd-0de57eb04c30 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:53.950791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:53.952052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:53.952333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:53.952604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] PATH_INFO: `/v3/system/users/f383c605dcd24ce5a90f500b94caeb6b/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:53.954478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f383c605dcd24ce5a90f500b94caeb6b, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:53.956837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:53.970945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 152/312] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Mar 24 14:39:53 2022] PUT /identity/v3/system/users/f383c605dcd24ce5a90f500b94caeb6b/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:54.025160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dec6a-2cf4-42d2-b93d-e441092dd7bd None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:54.063720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:54.065058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:54.065516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:54.065931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:54.078631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:54.086656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:54.092662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 161/313] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:54.094962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:54.200032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d815e0-33af-4ac5-82fb-819c1d97622b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:54.234752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:54.236113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:54.236539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:54.237044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:54.237945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:54.238435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:54.240035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:54.253247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 153/314] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:54.254869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:54.359281 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501f89b-10d9-4be3-a6d7-f62ef79a6b79 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:54.396622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:54.397726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:54.398203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:54.398739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] PATH_INFO: `/v3/users/4f4dcdd058af4b0f9df442b23f84beea` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:54.400128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] RBAC: Authorizing `identity:get_user(user_id=4f4dcdd058af4b0f9df442b23f84beea)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:54.401717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:54.408151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 162/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:54 2022] GET /identity/v3/users/4f4dcdd058af4b0f9df442b23f84beea => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:54.409692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:54.505356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74d308-8dc9-4225-b36b-b5706b4dbd2c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:54.537189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:54.537829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:54.538130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:54.538406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:54.603528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:54.604979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:54.699857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 154/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 24 14:39:54.705779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:54.808131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be911c-5f0f-449c-9603-fddca6d29e43 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:54.841155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef4d1-7022-4bb4-9ab0-fe25c3669401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:54.842415 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef4d1-7022-4bb4-9ab0-fe25c3669401 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:54.842898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef4d1-7022-4bb4-9ab0-fe25c3669401 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:54.843368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef4d1-7022-4bb4-9ab0-fe25c3669401 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:54.844769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adef4d1-7022-4bb4-9ab0-fe25c3669401 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:54.846504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adef4d1-7022-4bb4-9ab0-fe25c3669401 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:54.848443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 163/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:39:54 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:54.854306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:54.960998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d624d-bf2a-4910-9c94-7078fd5a6660 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:54.998383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7370-5a32-4cac-b582-7fa366d0e6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:54.999040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7370-5a32-4cac-b582-7fa366d0e6c8 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:54.999318 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7370-5a32-4cac-b582-7fa366d0e6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:54.999590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7370-5a32-4cac-b582-7fa366d0e6c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.000418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b7370-5a32-4cac-b582-7fa366d0e6c8 None admin] RBAC: Adding query filter params (role.id=69c9dab1a4b7414a8350c53d4ff261cd, scope.project.id=ca6dc7889e0142a289dff26d0208210e, user.id=4f4dcdd058af4b0f9df442b23f84beea) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:55.000724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b7370-5a32-4cac-b582-7fa366d0e6c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:55.002175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b7370-5a32-4cac-b582-7fa366d0e6c8 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:55.008649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 155/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:39:54 2022] GET /identity/v3/role_assignments?user.id=4f4dcdd058af4b0f9df442b23f84beea&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=69c9dab1a4b7414a8350c53d4ff261cd => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:55.337310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051a90-eabc-4d43-af76-26211361c6f9 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.337833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051a90-eabc-4d43-af76-26211361c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.337833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51051a90-eabc-4d43-af76-26211361c6f9 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.339663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 164/319] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:55.345133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7af7e-99dd-4f1b-acc7-8df23dfcecbc None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.345538 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7af7e-99dd-4f1b-acc7-8df23dfcecbc None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.345660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7af7e-99dd-4f1b-acc7-8df23dfcecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.362936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d5d7af7e-99dd-4f1b-acc7-8df23dfcecbc None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:55.364117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d5d7af7e-99dd-4f1b-acc7-8df23dfcecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:55.430889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 156/320] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:55.434794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2ace-24f6-42a7-9cf4-f5a7abc560ba None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.435089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2ace-24f6-42a7-9cf4-f5a7abc560ba None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.435370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa2ace-24f6-42a7-9cf4-f5a7abc560ba None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.437221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 165/321] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:55.442542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567478a-d980-4114-9a10-ba75f6fc035a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.442837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567478a-d980-4114-9a10-ba75f6fc035a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.443116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567478a-d980-4114-9a10-ba75f6fc035a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.452888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa2ace-24f6-42a7-9cf4-f5a7abc560ba None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:55.461081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7567478a-d980-4114-9a10-ba75f6fc035a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:55.462292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7567478a-d980-4114-9a10-ba75f6fc035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:55.526154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 157/322] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:55.548817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567478a-d980-4114-9a10-ba75f6fc035a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:55.554494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa2ace-24f6-42a7-9cf4-f5a7abc560ba None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:55.586615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:55.587802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.588301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.588769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.599100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:55.606211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:55.607508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 166/323] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:55.613435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:55.650653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567478a-d980-4114-9a10-ba75f6fc035a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:55.683385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:55.684175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.684451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.684720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.685868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:55.687337 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:55.689094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 158/324] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:39:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:55.694468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:55.711031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdf622-bc77-4d1a-bb68-aba583f1b6cd None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:55.743723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:55.744398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.744672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.744953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.745696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:55.746003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:55.747402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:55.759791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 167/325] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:39:55.760808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:55.792184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39625-0735-48de-9a31-89e282bf9676 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:55.824149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:55.824813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.825096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.825362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] PATH_INFO: `/v3/groups` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.826046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:55.827526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:55.843329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 159/326] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Mar 24 14:39:55 2022] POST /identity/v3/groups => generated 226 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:39:55.860180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0d77-ed15-4a2f-8615-c677e3437e8c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:55.900264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a310-cd0d-49fe-ae4e-8bf32d3553ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:55.901186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a310-cd0d-49fe-ae4e-8bf32d3553ee None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:55.901466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a310-cd0d-49fe-ae4e-8bf32d3553ee None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:55.901764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a310-cd0d-49fe-ae4e-8bf32d3553ee None admin] PATH_INFO: `/v3/users/624758b382114174a8b29fd479e77c83` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:55.903586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482a310-cd0d-49fe-ae4e-8bf32d3553ee None admin] RBAC: Authorizing `identity:get_user(user_id=624758b382114174a8b29fd479e77c83)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:55.904648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482a310-cd0d-49fe-ae4e-8bf32d3553ee None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:55.906679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 168/327] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:55 2022] GET /identity/v3/users/624758b382114174a8b29fd479e77c83 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:55.912478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:56.022519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc9ba5-5b68-4de6-87e9-670f3db4471a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:56.060641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecea34-ae3e-4354-8361-a40fe6462019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:56.061517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecea34-ae3e-4354-8361-a40fe6462019 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:56.061803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecea34-ae3e-4354-8361-a40fe6462019 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:56.062106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecea34-ae3e-4354-8361-a40fe6462019 None admin] PATH_INFO: `/v3/system/users/624758b382114174a8b29fd479e77c83/roles/69c9dab1a4b7414a8350c53d4ff261cd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:56.064285 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecea34-ae3e-4354-8361-a40fe6462019 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=624758b382114174a8b29fd479e77c83, role_id=69c9dab1a4b7414a8350c53d4ff261cd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:56.066106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecea34-ae3e-4354-8361-a40fe6462019 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:56.074727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 160/328] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Mar 24 14:39:55 2022] PUT /identity/v3/system/users/624758b382114174a8b29fd479e77c83/roles/69c9dab1a4b7414a8350c53d4ff261cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:39:56.354807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972c4d-8e0b-4015-8faf-6f6962b749f6 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:56.355361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972c4d-8e0b-4015-8faf-6f6962b749f6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:56.355361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972c4d-8e0b-4015-8faf-6f6962b749f6 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:56.357413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 169/329] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:56.362705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bde6b-9e93-4418-8923-9c7e3a253f8a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:56.363136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bde6b-9e93-4418-8923-9c7e3a253f8a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:56.363268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bde6b-9e93-4418-8923-9c7e3a253f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:56.381121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-980bde6b-9e93-4418-8923-9c7e3a253f8a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:56.382361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-980bde6b-9e93-4418-8923-9c7e3a253f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:56.448517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 161/330] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:56.473027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972c4d-8e0b-4015-8faf-6f6962b749f6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:56.572221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972c4d-8e0b-4015-8faf-6f6962b749f6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:56.605304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:56.606032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:56.606340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:56.606614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:56.616713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:56.623698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:56.625211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 170/331] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:56.631015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bde6b-9e93-4418-8923-9c7e3a253f8a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:56.727272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bde6b-9e93-4418-8923-9c7e3a253f8a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:56.760738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:56.761406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:56.761695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:56.761970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:56.762794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] RBAC: Adding query filter params (name=member) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:56.763106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:56.764468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:56.773195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 162/332] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:56.778729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:56.896958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa7cf5-37fb-4bd3-b50e-d56c668de507 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:56.943647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286229e0-a2ee-420d-81f4-080d2c02470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:56.944871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286229e0-a2ee-420d-81f4-080d2c02470a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:56.945334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286229e0-a2ee-420d-81f4-080d2c02470a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:56.945785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286229e0-a2ee-420d-81f4-080d2c02470a None admin] PATH_INFO: `/v3/users/f383c605dcd24ce5a90f500b94caeb6b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:56.947211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286229e0-a2ee-420d-81f4-080d2c02470a None admin] RBAC: Authorizing `identity:get_user(user_id=f383c605dcd24ce5a90f500b94caeb6b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:56.948833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286229e0-a2ee-420d-81f4-080d2c02470a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:56.950956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 171/333] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:39:56 2022] GET /identity/v3/users/f383c605dcd24ce5a90f500b94caeb6b => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:56.956697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:57.065739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33957bef-be85-420b-aef1-56a491958c06 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:57.107756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c4303-d85d-4098-a94e-bd162bce257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:57.108431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c4303-d85d-4098-a94e-bd162bce257f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:57.108714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c4303-d85d-4098-a94e-bd162bce257f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:57.108990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c4303-d85d-4098-a94e-bd162bce257f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:57.109831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c4303-d85d-4098-a94e-bd162bce257f None admin] RBAC: Adding query filter params (role.id=610442154bc84cae961360db5432b95b, user.id=f383c605dcd24ce5a90f500b94caeb6b, scope.system=all) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:57.110164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c4303-d85d-4098-a94e-bd162bce257f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:57.111694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c4303-d85d-4098-a94e-bd162bce257f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:57.124148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 163/334] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Mar 24 14:39:56 2022] GET /identity/v3/role_assignments?user.id=f383c605dcd24ce5a90f500b94caeb6b&scope.system=all&role.id=610442154bc84cae961360db5432b95b => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:58.583359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b269c0-c8f8-419e-8fb6-4f421994ef12 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:58.583921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b269c0-c8f8-419e-8fb6-4f421994ef12 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:58.583921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b269c0-c8f8-419e-8fb6-4f421994ef12 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:58.585670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 172/335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:58.599608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89c7ed-55eb-4dba-b4b2-87d90505b7f7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:58.600085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89c7ed-55eb-4dba-b4b2-87d90505b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:58.600186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89c7ed-55eb-4dba-b4b2-87d90505b7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:58.622883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7c89c7ed-55eb-4dba-b4b2-87d90505b7f7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:58.624052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7c89c7ed-55eb-4dba-b4b2-87d90505b7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:58.708072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 164/336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:58.736414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b269c0-c8f8-419e-8fb6-4f421994ef12 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:58.758409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1c24-9de8-457b-84bd-9047c54dccf6 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:58.758733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1c24-9de8-457b-84bd-9047c54dccf6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:58.758964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a1c24-9de8-457b-84bd-9047c54dccf6 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:58.760740 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 165/337] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:39:58.766022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001c527-e9af-49f3-8973-5b2f9f93878d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:58.766326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001c527-e9af-49f3-8973-5b2f9f93878d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:58.766597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001c527-e9af-49f3-8973-5b2f9f93878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:58.788005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c001c527-e9af-49f3-8973-5b2f9f93878d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:58.789166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c001c527-e9af-49f3-8973-5b2f9f93878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:58.911622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 166/338] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:39:58.921550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b269c0-c8f8-419e-8fb6-4f421994ef12 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:58.956050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001c527-e9af-49f3-8973-5b2f9f93878d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:58.971231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cbf17-fff8-4030-8b01-f7fdb114b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:58.972017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbf17-fff8-4030-8b01-f7fdb114b987 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:58.972296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbf17-fff8-4030-8b01-f7fdb114b987 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:58.972562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbf17-fff8-4030-8b01-f7fdb114b987 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:58.992997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cbf17-fff8-4030-8b01-f7fdb114b987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:58.999981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-d47cbf17-fff8-4030-8b01-f7fdb114b987 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:39:59.001203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 173/339] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:59.002496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660b52-e291-4f80-9815-02a995231386 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.002777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660b52-e291-4f80-9815-02a995231386 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.003047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660b52-e291-4f80-9815-02a995231386 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.004992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 174/340] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:39:59.010164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7af18-2d62-4e59-8bd5-fcee868e08d2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.010481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7af18-2d62-4e59-8bd5-fcee868e08d2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.010727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7af18-2d62-4e59-8bd5-fcee868e08d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.028320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-cfa7af18-2d62-4e59-8bd5-fcee868e08d2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:39:59.029544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cfa7af18-2d62-4e59-8bd5-fcee868e08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:39:59.126206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 175/341] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:39:59.127072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7af18-2d62-4e59-8bd5-fcee868e08d2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:59.143288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001c527-e9af-49f3-8973-5b2f9f93878d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:59.222572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:59.223359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.223640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.223911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.244658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:59.259912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:39:59.261170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 167/342] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:39:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:39:59.261934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:59.317998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7af18-2d62-4e59-8bd5-fcee868e08d2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:59.363583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:59.364262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.364539 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.364807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.365613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:59.365917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:59.367722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:59.377259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 176/343] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:59.378183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:59.437209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6422-0cc8-4ca1-afea-541bfe1755df None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:59.473909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:59.474661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.474986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.475258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.493518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:39:59.501354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 24 14:39:59.502841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 168/344] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:39:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:39:59.503395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:59.569622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f350f4-2212-4df3-95ee-e63a3a39a650 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:59.635004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:59.635790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.635947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.636192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.636938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:59.637239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:59.638789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:59.661467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 177/345] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:39:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:39:59.662438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:59.691635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9438555-1955-4f69-b686-cf5bc5699917 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:59.729159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:59.729781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.730062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.730368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.803843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:59.805314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:59.902651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 169/346] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:39:59.906325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:39:59.906446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03027c76-e36b-40ca-be97-bb13e777faf4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:39:59.985088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:39:59.985687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:39:59.985963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:39:59.986263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:39:59.987084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:39:59.987391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:39:59.988760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:39:59.999820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01089840-05e2-45e9-aa88-3a89ca28248c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.005397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 178/347] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:39:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.006259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.033380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.034034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.034358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.034630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.101297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.102827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.175738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e9d9b-ae06-41aa-b205-e5ae9db9f331 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.201965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 170/348] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:00.202863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.212538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc11357-29c1-4119-ab63-a90fa0dbb636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.213666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11357-29c1-4119-ab63-a90fa0dbb636 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.214639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11357-29c1-4119-ab63-a90fa0dbb636 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.215082 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11357-29c1-4119-ab63-a90fa0dbb636 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.216442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc11357-29c1-4119-ab63-a90fa0dbb636 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.218036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc11357-29c1-4119-ab63-a90fa0dbb636 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.219926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 179/349] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.221461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680e88f-7b47-4d96-a52b-cb9d0cc709e6 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.221888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680e88f-7b47-4d96-a52b-cb9d0cc709e6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.222350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680e88f-7b47-4d96-a52b-cb9d0cc709e6 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.229060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 180/350] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:00.230053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680e88f-7b47-4d96-a52b-cb9d0cc709e6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.303832 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f8dd-950a-4219-a342-0ef8ec6fcfee None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.338179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.339055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.339333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.339602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] PATH_INFO: `/v3/users/624758b382114174a8b29fd479e77c83` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.340325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680e88f-7b47-4d96-a52b-cb9d0cc709e6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.340803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] RBAC: Authorizing `identity:get_user(user_id=624758b382114174a8b29fd479e77c83)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.342319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.343995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 171/351] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/users/624758b382114174a8b29fd479e77c83 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.344890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.380584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb28beb-2846-4d03-9b07-d47ec86efafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.381964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb28beb-2846-4d03-9b07-d47ec86efafc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.382438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb28beb-2846-4d03-9b07-d47ec86efafc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.382851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb28beb-2846-4d03-9b07-d47ec86efafc None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.384237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb28beb-2846-4d03-9b07-d47ec86efafc None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.385821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb28beb-2846-4d03-9b07-d47ec86efafc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.388004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 181/352] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.389304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c04c-5da1-4196-a593-0b7266733f53 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.389727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c04c-5da1-4196-a593-0b7266733f53 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.390203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c04c-5da1-4196-a593-0b7266733f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.407322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ef35c04c-5da1-4196-a593-0b7266733f53 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:00.408777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ef35c04c-5da1-4196-a593-0b7266733f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:00.443593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7e92-dae9-4900-a17b-6ac7d8b549c9 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.479005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.479920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.480236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.480514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.481886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 182/353] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:00.482888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c04c-5da1-4196-a593-0b7266733f53 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.490210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.490210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.490210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 172/354] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.490624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.589446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361f4ab-8131-4248-8b8b-3a7c9767e4bf None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.606343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c04c-5da1-4196-a593-0b7266733f53 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.628502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.630213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.630756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.631179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.633014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.635058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.637861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 173/355] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.639100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.644071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.644738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.645015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.645284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.646151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] RBAC: Adding query filter params (role.id=69c9dab1a4b7414a8350c53d4ff261cd, user.id=624758b382114174a8b29fd479e77c83, scope.system=all) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:00.646463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.647901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.663996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 183/356] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/role_assignments?user.id=624758b382114174a8b29fd479e77c83&scope.system=all&role.id=69c9dab1a4b7414a8350c53d4ff261cd => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.664839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.785338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bfd20-e56c-4613-a4e4-01ef06c4a04d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.825712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.826588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.826869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.827142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.839908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:00.847285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:40:00.849151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 184/357] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:00.850305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.907483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14829-39b6-4175-8196-c7142282e94c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:00.949615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f723e0-222a-44f7-beda-5561898d3f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:00.950680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f723e0-222a-44f7-beda-5561898d3f6b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.951083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f723e0-222a-44f7-beda-5561898d3f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.951488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f723e0-222a-44f7-beda-5561898d3f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.952334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f723e0-222a-44f7-beda-5561898d3f6b None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=610442154bc84cae961360db5432b95b, scope.project.id=982ec084345c45a48babdcb73560bce8) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:00.952792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f723e0-222a-44f7-beda-5561898d3f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:00.954619 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f723e0-222a-44f7-beda-5561898d3f6b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:00.960810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 174/358] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=610442154bc84cae961360db5432b95b => generated 260 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:00.961809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569e5c-11a6-4083-9859-3e69508dfccd None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:00.962114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569e5c-11a6-4083-9859-3e69508dfccd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:00.962608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569e5c-11a6-4083-9859-3e69508dfccd None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:00.964007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 175/359] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:00.964698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569e5c-11a6-4083-9859-3e69508dfccd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:00.974271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c273e-8b48-44bc-9d4a-81e37cad6003 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.032258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871967e-e265-4e18-ab7a-288e665b4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.033821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871967e-e265-4e18-ab7a-288e665b4b53 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.034391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871967e-e265-4e18-ab7a-288e665b4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.034882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871967e-e265-4e18-ab7a-288e665b4b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.035944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871967e-e265-4e18-ab7a-288e665b4b53 None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=982ec084345c45a48babdcb73560bce8) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:01.036953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871967e-e265-4e18-ab7a-288e665b4b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:01.039964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871967e-e265-4e18-ab7a-288e665b4b53 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:01.050351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 185/360] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:01.051987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5eb35-8364-4c6c-9e4b-3251dc93e962 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.052275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5eb35-8364-4c6c-9e4b-3251dc93e962 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.052552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5eb35-8364-4c6c-9e4b-3251dc93e962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.091633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-28c5eb35-8364-4c6c-9e4b-3251dc93e962 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:01.092770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-28c5eb35-8364-4c6c-9e4b-3251dc93e962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:01.162936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569e5c-11a6-4083-9859-3e69508dfccd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.171745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 186/361] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:01.209051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9e7fd-d108-4492-a88f-2e937ae35ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.209860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9e7fd-d108-4492-a88f-2e937ae35ce8 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.210201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9e7fd-d108-4492-a88f-2e937ae35ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.210489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9e7fd-d108-4492-a88f-2e937ae35ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.211305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9e7fd-d108-4492-a88f-2e937ae35ce8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:01.211621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9e7fd-d108-4492-a88f-2e937ae35ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:01.214307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9e7fd-d108-4492-a88f-2e937ae35ce8 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:01.214448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b4dd-09c7-4f2c-a71b-74f23265b21c None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.214845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b4dd-09c7-4f2c-a71b-74f23265b21c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.215252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b4dd-09c7-4f2c-a71b-74f23265b21c None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.218115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 187/362] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:01.220139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b4dd-09c7-4f2c-a71b-74f23265b21c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:01.227230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 176/363] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:01.228665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440c75-fd2a-4b25-afb7-eb62473ba12c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.228953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440c75-fd2a-4b25-afb7-eb62473ba12c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.229225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440c75-fd2a-4b25-afb7-eb62473ba12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.252001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-51440c75-fd2a-4b25-afb7-eb62473ba12c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:01.253532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-51440c75-fd2a-4b25-afb7-eb62473ba12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:01.338159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 177/364] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:01.339012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440c75-fd2a-4b25-afb7-eb62473ba12c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:01.374624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b4dd-09c7-4f2c-a71b-74f23265b21c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.412063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.413215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.413646 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.414056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.425108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:01.432836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:40:01.437477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 188/365] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:01.438515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:01.464364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440c75-fd2a-4b25-afb7-eb62473ba12c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.506353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.508588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.508588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.508588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.553986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e747458-cee3-43ff-bbd2-c4aeacd890ac None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.588083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:01.589531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:01.590835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.591830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.592255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.592692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.603519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:01.611495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:01.613360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 189/366] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:01.614297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:01.709085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 178/367] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:01.709861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:01.723296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faf4ab-e531-44b6-8f73-8c15133e9a78 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.758329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.759424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.759856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.760545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.761451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:01.761913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:01.764200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:01.778298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 190/368] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:01.779924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:01.821980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223005f3-ee1c-45ae-922e-24f3e35e27aa None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.867686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.868708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.869342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.870290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.871542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:01.872169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:01.874064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:01.885513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 179/369] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:01.886755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:01.894145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f682005-95d1-4ba6-9e27-e6dc6f5615eb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:01.931783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:01.932648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:01.932920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:01.933185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:01.934399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:01.935834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:01.937914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 191/370] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:01.938856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.008368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1181e-417b-4998-b8cc-85a301a2e216 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.040502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26bf0b-5db1-4484-91e7-9786763fc4f9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.041566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.042257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.042542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.042821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.075226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.075996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.076279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.076553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.112985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.114550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.155019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.156490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.220345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 180/371] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:02.221256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.260618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 192/372] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:02.261469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.323937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273810e-db29-4472-83f1-2c48e76532d7 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.358277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.359149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.359424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.359693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.360957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.362524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.362828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b4976-142e-4ed9-b063-e0d6c75f8253 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.364580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 181/373] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:02.365409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.402952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.403831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.404114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.404391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.405601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.407082 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.409111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 193/374] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:02.410905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.466206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30199ef5-c554-4f42-bce7-34fdd4cc5226 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.499666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.500574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.500853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.501118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] PATH_INFO: `/v3/projects/3c10c7d278dd470682481e8cf01ddafe` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.502357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] RBAC: Authorizing `identity:get_project(project_id=3c10c7d278dd470682481e8cf01ddafe)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.503783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.505759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 182/375] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/projects/3c10c7d278dd470682481e8cf01ddafe => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:02.506539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.520445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e6bea-aaa1-4291-a009-53950ec7796c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.554166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.554973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.555266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.555543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.556377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=610442154bc84cae961360db5432b95b, scope.project.id=ca6dc7889e0142a289dff26d0208210e) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:02.556688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.558159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.563650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 194/376] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=610442154bc84cae961360db5432b95b => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:02.564501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.610943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdd658-5b0b-43a4-9b7d-aae012ee0b1c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.646069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.646957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.647290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.647560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.648726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.650253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.651918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 183/377] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:02.657950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.668315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203ef7-2991-48d5-9fec-1d5d35317141 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.703368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.704247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.704531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.705119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] PATH_INFO: `/v3/groups/1eba3cdba9574aa3892f6d53c2b10feb` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.711640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] RBAC: Authorizing `identity:get_group(group_id=1eba3cdba9574aa3892f6d53c2b10feb)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.713107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.715226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 195/378] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/groups/1eba3cdba9574aa3892f6d53c2b10feb => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:02.724452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:02.801783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce9be-26b0-48d3-8592-7df0e6484de9 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.872898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19038c-8b98-421a-ad76-386e37f494d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.873562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19038c-8b98-421a-ad76-386e37f494d8 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.873839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19038c-8b98-421a-ad76-386e37f494d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.874131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19038c-8b98-421a-ad76-386e37f494d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.876652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19038c-8b98-421a-ad76-386e37f494d8 None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=ca6dc7889e0142a289dff26d0208210e) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:02.876960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19038c-8b98-421a-ad76-386e37f494d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.878495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19038c-8b98-421a-ad76-386e37f494d8 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.891217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 184/379] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:02.908996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fa7d-a78d-485a-bb9a-e655c725159a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:02.963867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e47dc-1106-4ef9-8d66-d0c4c2f2202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:02.964552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e47dc-1106-4ef9-8d66-d0c4c2f2202e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:02.964860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e47dc-1106-4ef9-8d66-d0c4c2f2202e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:02.965101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e47dc-1106-4ef9-8d66-d0c4c2f2202e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:02.965992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e47dc-1106-4ef9-8d66-d0c4c2f2202e None admin] RBAC: Adding query filter params (group.id=1eba3cdba9574aa3892f6d53c2b10feb, role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=3c10c7d278dd470682481e8cf01ddafe) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:02.966371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e47dc-1106-4ef9-8d66-d0c4c2f2202e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:02.967818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e47dc-1106-4ef9-8d66-d0c4c2f2202e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:02.978955 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 196/380] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:02 2022] GET /identity/v3/role_assignments?group.id=1eba3cdba9574aa3892f6d53c2b10feb&scope.project.id=3c10c7d278dd470682481e8cf01ddafe&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:03.736433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb77d4-1827-46fd-b905-197799adcb5c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:03.737439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb77d4-1827-46fd-b905-197799adcb5c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:03.737925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb77d4-1827-46fd-b905-197799adcb5c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:03.740255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 185/381] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:03.745339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a330d3c-48e2-48d2-9aa5-f687a47d30a0 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:03.746147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a330d3c-48e2-48d2-9aa5-f687a47d30a0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:03.746839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a330d3c-48e2-48d2-9aa5-f687a47d30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:03.771506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7a330d3c-48e2-48d2-9aa5-f687a47d30a0 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:03.772676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7a330d3c-48e2-48d2-9aa5-f687a47d30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:03.812513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d594-aa9a-45f8-bbed-675f9775b44c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:03.813135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d594-aa9a-45f8-bbed-675f9775b44c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:03.813907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d594-aa9a-45f8-bbed-675f9775b44c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:03.816213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 186/382] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:03.831151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a0ea-08f8-4f1f-ab97-5bac11679d53 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:03.831754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a0ea-08f8-4f1f-ab97-5bac11679d53 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:03.832219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166a0ea-08f8-4f1f-ab97-5bac11679d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:03.856402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a166a0ea-08f8-4f1f-ab97-5bac11679d53 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:03.857793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a166a0ea-08f8-4f1f-ab97-5bac11679d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:03.894027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 197/383] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:03.941297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a330d3c-48e2-48d2-9aa5-f687a47d30a0 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:03.957473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 187/384] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:03.998495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166a0ea-08f8-4f1f-ab97-5bac11679d53 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.112099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a330d3c-48e2-48d2-9aa5-f687a47d30a0 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.162837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.163910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.164351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.164771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.165676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166a0ea-08f8-4f1f-ab97-5bac11679d53 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.179080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:04.194310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:40:04.196194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 198/385] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:04.202820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.212631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.213452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.213729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.214004 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.235346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:04.246943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:40:04.248710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 188/386] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:04.254826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.314756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386328d1-f4ef-47a0-8a2a-8d962260b3c9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.351576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.352488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.352905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.353310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.355206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:04.355655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:04.357318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:04.373059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 199/387] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:40:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:04.378389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.397029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb3c08-6f9f-47d6-a8be-50c8e30ec5aa None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.441390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.442475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.442950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.443431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.444388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:04.444880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:04.446464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:04.460724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 189/388] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:04.466242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.492106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61570bf-ba07-4cb2-98ff-6402bd186205 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.528488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.529585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.530000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.530456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.534862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:04.536551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:04.538828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 200/389] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:04 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:04.545316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.582227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e3091-6714-47db-8074-89d8022b7658 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.620731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.621944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.622450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.622906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.624408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:04.627291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:04.631001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 190/390] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:04 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:04.636625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.716018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728df24-3e8d-4b11-9d64-13c644e1f1c4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.780493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.782169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.782640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.783095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.786290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:04.789311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:04.792607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 201/391] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:04 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:04.799993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.823593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a86a16-705a-4d06-82c3-235f73f1627c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.873847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:04.875114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:04.875594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:04.876049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:04.877480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:04.879138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:04.881351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 191/392] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:04 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:04.886930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:04.976754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5c4a2-4bfa-48fd-9789-55e8b3681503 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:04.989280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5329-2a6d-4a0c-a3f6-398b8befca31 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:05.024620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7ba3e-516c-4051-9cd1-0c570eb709ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:05.025516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ba3e-516c-4051-9cd1-0c570eb709ff None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:05.025793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ba3e-516c-4051-9cd1-0c570eb709ff None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:05.026066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7ba3e-516c-4051-9cd1-0c570eb709ff None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8/groups/d80dde7b0348482abc23e19e3671c025/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:05.031011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7ba3e-516c-4051-9cd1-0c570eb709ff None admin] RBAC: Authorizing `identity:create_grant(project_id=982ec084345c45a48babdcb73560bce8, group_id=d80dde7b0348482abc23e19e3671c025, role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:05.032389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7ba3e-516c-4051-9cd1-0c570eb709ff None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:05.036181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b883cf-f686-42d7-87fc-abfc4d12e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:05.037070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b883cf-f686-42d7-87fc-abfc4d12e61e None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:05.037344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b883cf-f686-42d7-87fc-abfc4d12e61e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:05.037614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b883cf-f686-42d7-87fc-abfc4d12e61e None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8/groups/d80dde7b0348482abc23e19e3671c025/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:05.040861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b883cf-f686-42d7-87fc-abfc4d12e61e None admin] RBAC: Authorizing `identity:create_grant(project_id=982ec084345c45a48babdcb73560bce8, group_id=d80dde7b0348482abc23e19e3671c025, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:05.042311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b883cf-f686-42d7-87fc-abfc4d12e61e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:05.061779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 192/393] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Mar 24 14:40:04 2022] PUT /identity/v3/projects/982ec084345c45a48babdcb73560bce8/groups/d80dde7b0348482abc23e19e3671c025/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:05.070522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 202/394] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Mar 24 14:40:04 2022] PUT /identity/v3/projects/982ec084345c45a48babdcb73560bce8/groups/d80dde7b0348482abc23e19e3671c025/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:05.583360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105bc3d-4482-479d-b7b4-6378b3a58d0e None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:05.583764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105bc3d-4482-479d-b7b4-6378b3a58d0e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:05.583970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105bc3d-4482-479d-b7b4-6378b3a58d0e None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:05.586227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 193/395] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:05.592031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5404e-e226-4468-8610-9b1ce3c0b892 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:05.592576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5404e-e226-4468-8610-9b1ce3c0b892 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:05.593072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5404e-e226-4468-8610-9b1ce3c0b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:05.615124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5bc5404e-e226-4468-8610-9b1ce3c0b892 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:05.616679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5bc5404e-e226-4468-8610-9b1ce3c0b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:05.693622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 203/396] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:05.732860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105bc3d-4482-479d-b7b4-6378b3a58d0e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:05.852035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105bc3d-4482-479d-b7b4-6378b3a58d0e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:05.904689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7737267-2f42-4e47-bfa8-a9e5bc4c147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:05.905754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7737267-2f42-4e47-bfa8-a9e5bc4c147a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:05.906254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7737267-2f42-4e47-bfa8-a9e5bc4c147a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:05.906763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7737267-2f42-4e47-bfa8-a9e5bc4c147a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:05.920611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7737267-2f42-4e47-bfa8-a9e5bc4c147a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:05.928231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e7737267-2f42-4e47-bfa8-a9e5bc4c147a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:40:05.929713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 194/397] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:05.935638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5404e-e226-4468-8610-9b1ce3c0b892 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.030907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2817-b064-4f85-bde5-776a75478790 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.031548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2817-b064-4f85-bde5-776a75478790 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.032026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb2817-b064-4f85-bde5-776a75478790 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.034061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 195/398] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:06.039336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559d09e-f328-4cef-9a32-157b6c5560ba None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.039977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559d09e-f328-4cef-9a32-157b6c5560ba None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.040463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559d09e-f328-4cef-9a32-157b6c5560ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.060821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5404e-e226-4468-8610-9b1ce3c0b892 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:06.071655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b559d09e-f328-4cef-9a32-157b6c5560ba None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:06.073075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b559d09e-f328-4cef-9a32-157b6c5560ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:06.098583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:06.099431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.099743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.100002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.100971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:06.101285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:06.102809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:06.112605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 204/399] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:06.118320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.218561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b03e33-c94e-43b0-a891-0e4c98442133 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:06.228374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 196/400] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:06.252808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:06.253973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.254460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.255055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.256466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:06.258076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:06.260286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 205/401] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:06 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:06.265492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559d09e-f328-4cef-9a32-157b6c5560ba None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.271440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.371571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f8e5f-bef3-4daf-a140-45af113cf0a8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:06.405499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:06.406579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.407007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.407444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.418919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:06.426508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:06.428412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 206/402] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:06.434379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.443960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559d09e-f328-4cef-9a32-157b6c5560ba None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:06.488650 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:06.489767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.490217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.490648 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.494810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:06.496428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:06.498329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 197/403] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:06 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:06.504160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.556256 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aacf7-08c1-407a-981d-ef644b622857 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:06.590340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0a9f1-b181-4ac6-8937-29264865fa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:06.591311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0a9f1-b181-4ac6-8937-29264865fa00 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.591734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0a9f1-b181-4ac6-8937-29264865fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.592152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0a9f1-b181-4ac6-8937-29264865fa00 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.593221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0a9f1-b181-4ac6-8937-29264865fa00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:06.593673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0a9f1-b181-4ac6-8937-29264865fa00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:06.595209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0a9f1-b181-4ac6-8937-29264865fa00 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:06.604142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 207/404] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:06.607301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e0468-76e1-4429-b348-ce1f171c0945 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.607744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e0468-76e1-4429-b348-ce1f171c0945 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.608285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e0468-76e1-4429-b348-ce1f171c0945 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.610509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 208/405] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:06.612856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e0468-76e1-4429-b348-ce1f171c0945 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.636513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a693-f501-473d-9855-78634d3aeefb None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:06.670040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b51f8-e440-4952-8edc-b54d2001ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:06.671129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b51f8-e440-4952-8edc-b54d2001ebfd None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.671472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b51f8-e440-4952-8edc-b54d2001ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.671838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b51f8-e440-4952-8edc-b54d2001ebfd None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e/groups/d80dde7b0348482abc23e19e3671c025/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.674155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b51f8-e440-4952-8edc-b54d2001ebfd None admin] RBAC: Authorizing `identity:create_grant(project_id=ca6dc7889e0142a289dff26d0208210e, group_id=d80dde7b0348482abc23e19e3671c025, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:06.675558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b51f8-e440-4952-8edc-b54d2001ebfd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:06.692741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 198/406] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Mar 24 14:40:06 2022] PUT /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e/groups/d80dde7b0348482abc23e19e3671c025/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:40:06.694254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4538b7-d26c-4893-8a0a-eb265f8665a8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.694635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4538b7-d26c-4893-8a0a-eb265f8665a8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.695004 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4538b7-d26c-4893-8a0a-eb265f8665a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.728896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3d4538b7-d26c-4893-8a0a-eb265f8665a8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:06.730718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3d4538b7-d26c-4893-8a0a-eb265f8665a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:06.750032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e0468-76e1-4429-b348-ce1f171c0945 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:06.788095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:06.789312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:06.789680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:06.790098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] PATH_INFO: `/v3/groups/1eba3cdba9574aa3892f6d53c2b10feb` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:06.791681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] RBAC: Authorizing `identity:get_group(group_id=1eba3cdba9574aa3892f6d53c2b10feb)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:06.794231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:06.796403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 209/407] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:06 2022] GET /identity/v3/groups/1eba3cdba9574aa3892f6d53c2b10feb => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:06.801990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.887681 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 199/408] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:06.922063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4538b7-d26c-4893-8a0a-eb265f8665a8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:06.949194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520b823-e1df-44de-9526-3c1c711c4d82 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:07.008748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:07.009907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.010361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.010803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] PATH_INFO: `/v3/projects/3c10c7d278dd470682481e8cf01ddafe` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.012233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=3c10c7d278dd470682481e8cf01ddafe)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:07.013897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:07.016598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 210/409] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:06 2022] GET /identity/v3/projects/3c10c7d278dd470682481e8cf01ddafe => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:07.027612 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:07.061741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4538b7-d26c-4893-8a0a-eb265f8665a8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:07.096897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:07.097895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.098268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.098629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.109494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:07.117258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:40:07.118959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 200/410] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:07.124581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:07.131998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4359-8d3a-4db3-922e-6c8581cb3bb1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:07.166708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:07.167853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.168291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.168721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] PATH_INFO: `/v3/projects/3c10c7d278dd470682481e8cf01ddafe/groups/1eba3cdba9574aa3892f6d53c2b10feb/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.170874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c10c7d278dd470682481e8cf01ddafe, group_id=1eba3cdba9574aa3892f6d53c2b10feb, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:07.172811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:07.193571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 211/411] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Mar 24 14:40:07 2022] PUT /identity/v3/projects/3c10c7d278dd470682481e8cf01ddafe/groups/1eba3cdba9574aa3892f6d53c2b10feb/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:07.233100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89b0c4-ff5f-48b9-be56-186c13d20b6a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:07.270512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:07.271235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.271517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.271790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.272551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:07.272861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:07.274301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:07.284148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 201/412] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:07.289987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:07.433193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58230ae-c8e5-44be-aa6c-24ed1a558968 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:07.469406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:07.470299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.470580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.470894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.472069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:07.473505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:07.475444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 212/413] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:07 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:07.480960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:07.582501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32139fb6-91c9-4685-b4dd-5dcf0024cdb7 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:07.615690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aec3a-89fa-4b56-adc2-cb8f8e1ff703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:07.616602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aec3a-89fa-4b56-adc2-cb8f8e1ff703 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.616915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aec3a-89fa-4b56-adc2-cb8f8e1ff703 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.617190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aec3a-89fa-4b56-adc2-cb8f8e1ff703 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.618409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aec3a-89fa-4b56-adc2-cb8f8e1ff703 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:07.619844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aec3a-89fa-4b56-adc2-cb8f8e1ff703 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:07.621819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 202/414] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:07 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:07.627494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:07.749837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6d46f-034b-44df-a3d0-d5a7e2a2a0c8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:07.789165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:07.790050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.790349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.790619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e/groups/d80dde7b0348482abc23e19e3671c025/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.792787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] RBAC: Authorizing `identity:create_grant(project_id=ca6dc7889e0142a289dff26d0208210e, group_id=d80dde7b0348482abc23e19e3671c025, role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:07.794264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:07.817245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa8347-303d-4ca4-9509-5f54cd9ec5e9 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.817539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa8347-303d-4ca4-9509-5f54cd9ec5e9 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.817966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa8347-303d-4ca4-9509-5f54cd9ec5e9 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.820103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 203/416] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:07.820314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 213/416] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Mar 24 14:40:07 2022] PUT /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e/groups/d80dde7b0348482abc23e19e3671c025/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:40:07.840343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353bb8-c722-4a3b-9c39-ff2f1bc7a478 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:07.840691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353bb8-c722-4a3b-9c39-ff2f1bc7a478 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:07.840899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353bb8-c722-4a3b-9c39-ff2f1bc7a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:07.871467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-84353bb8-c722-4a3b-9c39-ff2f1bc7a478 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:07.872776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-84353bb8-c722-4a3b-9c39-ff2f1bc7a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:07.964201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 204/417] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:07.994279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:08.089896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01359e5-b643-416c-9281-aaadaf507e90 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.090515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01359e5-b643-416c-9281-aaadaf507e90 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.090972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01359e5-b643-416c-9281-aaadaf507e90 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:08.093096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 205/418] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:08.098428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de94cd-16b2-4f88-bbc3-3e449010aff4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.098811 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de94cd-16b2-4f88-bbc3-3e449010aff4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.099180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de94cd-16b2-4f88-bbc3-3e449010aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:08.124191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d6de94cd-16b2-4f88-bbc3-3e449010aff4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:08.125506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d6de94cd-16b2-4f88-bbc3-3e449010aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:08.132705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9275-2294-45c8-83cc-4cc558bccb4e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:08.177580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:08.178669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.179154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.179592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:08.190469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:08.198790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:40:08.200525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 214/419] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:08.206448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 206/420] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:08.208433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:08.241500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de94cd-16b2-4f88-bbc3-3e449010aff4 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:08.367864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff8a6-2a58-44dc-89cd-2febe30439d4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:08.404925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:08.405602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.405889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.406194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:08.407403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:08.407716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:08.409138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:08.419283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 215/421] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:08.424232 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:08.433292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de94cd-16b2-4f88-bbc3-3e449010aff4 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:08.508446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:08.509250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.509530 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.509807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:08.539109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:08.546148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:40:08.547688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 207/422] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:08.553341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:08.576773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d9599-1877-4e1f-a020-d84c47c47458 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:08.613259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:08.614284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.615114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.615714 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:08.717177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ed8e8-ed3d-42f6-8328-ada3a3c5971e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:08.751795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:08.752187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:08.753056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.753516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.753664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:08.754116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:08.755340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:08.755842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:08.757367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:08.766133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 208/423] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:40:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:08.773134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:08.927942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 216/424] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:08.934336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:08.945778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193b8af-5d78-4988-85fa-04e2d21e04f0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:08.989227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:08.990636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:08.991232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:08.991754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.058727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:09.060465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:09.071980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b7f71-f515-4fa3-91e3-f066d6b2ea6e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:09.105754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:09.106653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.106936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.107209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.108406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:09.109854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:09.111973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 217/425] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:08 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:09.116858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:09.225737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 209/426] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:09.231398 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:09.301703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a13cc-a9ce-4507-b694-ad2864c4c553 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:09.368745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:09.371293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.372516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.372993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.375321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:09.378147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:09.383980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 218/427] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:09 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:09.386282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:09.410716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca1924-da04-40f4-b992-efd04b20017f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:09.474714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:09.477349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.477835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.479362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] PATH_INFO: `/v3/projects/982ec084345c45a48babdcb73560bce8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.482915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] RBAC: Authorizing `identity:get_project(project_id=982ec084345c45a48babdcb73560bce8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:09.484639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:09.488021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 210/428] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:09 2022] GET /identity/v3/projects/982ec084345c45a48babdcb73560bce8 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:09.495404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:09.585270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041983a-69b7-475a-9a92-f394ae4dac65 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:09.633189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:09.633839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.634146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.634419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.635243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=982ec084345c45a48babdcb73560bce8) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:09.635547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:09.636974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:09.643219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 219/429] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:09 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:09.691761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6ea2-d969-4302-9f7c-7f92c5c941e5 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:09.746870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b058dc-e2df-494b-a33c-fca4d8930e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:09.748039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b058dc-e2df-494b-a33c-fca4d8930e67 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.748477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b058dc-e2df-494b-a33c-fca4d8930e67 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.748897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b058dc-e2df-494b-a33c-fca4d8930e67 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.750353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b058dc-e2df-494b-a33c-fca4d8930e67 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:09.752026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b058dc-e2df-494b-a33c-fca4d8930e67 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:09.754317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 211/430] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:09 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:09.760016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:09.921620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4515ae5-8aa5-4e8d-b255-9598f74f7782 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:09.963947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca291b-e412-424a-8c5a-56cda208e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:09.964594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca291b-e412-424a-8c5a-56cda208e478 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.964873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca291b-e412-424a-8c5a-56cda208e478 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.965144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca291b-e412-424a-8c5a-56cda208e478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.965473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd406dc-18b6-436a-bccb-9f3d1b51f215 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.965954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd406dc-18b6-436a-bccb-9f3d1b51f215 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.966063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca291b-e412-424a-8c5a-56cda208e478 None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=610442154bc84cae961360db5432b95b, scope.project.id=982ec084345c45a48babdcb73560bce8) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:09.966323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca291b-e412-424a-8c5a-56cda208e478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:09.966787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd406dc-18b6-436a-bccb-9f3d1b51f215 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.967721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca291b-e412-424a-8c5a-56cda208e478 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:09.972775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 212/431] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:09.974886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f6b8-d7f6-4a7f-a3f0-d44b3155b455 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:09.975407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f6b8-d7f6-4a7f-a3f0-d44b3155b455 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:09.976185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f6b8-d7f6-4a7f-a3f0-d44b3155b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:09.979226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 220/432] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:09 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=982ec084345c45a48babdcb73560bce8&role.id=610442154bc84cae961360db5432b95b => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:10.003832 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ca61f6b8-d7f6-4a7f-a3f0-d44b3155b455 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:10.005029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ca61f6b8-d7f6-4a7f-a3f0-d44b3155b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:10.028703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9863e-3173-42f8-901b-b8472ff23ab8 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.028987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9863e-3173-42f8-901b-b8472ff23ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.029268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9863e-3173-42f8-901b-b8472ff23ab8 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.031439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 221/433] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:10.038339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e7804-1221-4ac5-a596-8975f1aa9d31 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.038618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e7804-1221-4ac5-a596-8975f1aa9d31 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.038899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e7804-1221-4ac5-a596-8975f1aa9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.070659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-956e7804-1221-4ac5-a596-8975f1aa9d31 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:10.071543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-956e7804-1221-4ac5-a596-8975f1aa9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:10.088173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 213/434] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:10.111457 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61f6b8-d7f6-4a7f-a3f0-d44b3155b455 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.161882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 222/435] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:10.188605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e7804-1221-4ac5-a596-8975f1aa9d31 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.216401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61f6b8-d7f6-4a7f-a3f0-d44b3155b455 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:10.254823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:10.255637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.255919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.256208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.270475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:10.277526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:10.279076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 214/436] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:10.284715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.307694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e7804-1221-4ac5-a596-8975f1aa9d31 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:10.357480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:10.358659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.359164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.359494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.376743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:10.383715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 24 14:40:10.385094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 223/437] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:10.390985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.408286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4048d-d33d-4e5d-be41-09c83941b6ee None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:10.450801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:10.452143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.452588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.452868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.453918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:10.454254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:10.456507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:10.469552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 215/438] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:10.470499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.505384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d1ee9-fe78-4b55-8b52-c7fcd3d0b564 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:10.544394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e3b76-f296-4c54-84d9-bc34af302abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:10.545078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e3b76-f296-4c54-84d9-bc34af302abc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.545422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e3b76-f296-4c54-84d9-bc34af302abc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.545705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e3b76-f296-4c54-84d9-bc34af302abc None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.546488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e3b76-f296-4c54-84d9-bc34af302abc None admin] RBAC: Adding query filter params (name=member) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:10.546797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e3b76-f296-4c54-84d9-bc34af302abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:10.548179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e3b76-f296-4c54-84d9-bc34af302abc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:10.557261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 224/439] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:10.558364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4433773-c8bf-407c-9cc7-c6cb05634ad2 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.558656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4433773-c8bf-407c-9cc7-c6cb05634ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.558944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4433773-c8bf-407c-9cc7-c6cb05634ad2 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.561110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 225/440] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:10.566683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31166e0-fca1-40c2-baf7-b3a3b5ebc6e6 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.567012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31166e0-fca1-40c2-baf7-b3a3b5ebc6e6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.567305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31166e0-fca1-40c2-baf7-b3a3b5ebc6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.578457 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0442c-61e9-44f0-94be-4d894e2b0f93 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:10.586555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a31166e0-fca1-40c2-baf7-b3a3b5ebc6e6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:10.588045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a31166e0-fca1-40c2-baf7-b3a3b5ebc6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:10.619207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:10.619862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.620142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.620416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.655045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 226/441] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:10.657355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31166e0-fca1-40c2-baf7-b3a3b5ebc6e6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.683305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:10.684757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:10.748662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31166e0-fca1-40c2-baf7-b3a3b5ebc6e6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:10.778529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 216/442] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 24 14:40:10.779390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.779565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:10.780166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.780450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.780727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.845034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:10.846572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:10.872978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d2fd8-dd94-4e2a-ad8f-46ce5f3bee23 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:10.906186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:10.907003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:10.907285 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:10.907559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:10.917442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:10.924820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:40:10.925994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 217/443] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:10.926768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:10.946607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 227/444] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:10.946607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.018490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a645-2cf6-437c-aff6-e0e8244c1957 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.037435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94197b-128f-4159-b0f5-a09bbc15c906 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.051023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.051859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.052147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.052419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] PATH_INFO: `/v3/projects/3c10c7d278dd470682481e8cf01ddafe` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.053593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] RBAC: Authorizing `identity:get_project(project_id=3c10c7d278dd470682481e8cf01ddafe)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.055051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.056748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 218/445] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/projects/3c10c7d278dd470682481e8cf01ddafe => generated 344 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.057522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.073330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.073998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.074322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.074597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.075362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:11.075667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.077036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.085247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 228/446] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.086011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.153316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29431145-d643-4345-a1c1-7087a8fd481b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.185993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.186884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.187168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.187456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.188631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.189101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3953c0-eda6-4b7d-98c5-6839db0e2ed8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.190131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.191817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 219/447] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.192574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.221156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.222013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.222322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.222593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] PATH_INFO: `/v3/groups/1eba3cdba9574aa3892f6d53c2b10feb` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.223767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] RBAC: Authorizing `identity:get_group(group_id=1eba3cdba9574aa3892f6d53c2b10feb)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.225213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.226879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 229/448] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/groups/1eba3cdba9574aa3892f6d53c2b10feb => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.227617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.287393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6ebfc-40b0-45e4-8162-1d4fb33c6869 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.318943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.319558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.319849 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.320125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.325511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb2393-88b2-4423-9f6f-1db9195b9583 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.357876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.358730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.359008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.359280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.360454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.361903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.363515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 230/449] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.364249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.384746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.386240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.459570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19ce8-cdc9-453c-868a-b318e825e065 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.483484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 220/450] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:11.484204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.492325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.492971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.493247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.493512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.494378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] RBAC: Adding query filter params (group.id=1eba3cdba9574aa3892f6d53c2b10feb, role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=3c10c7d278dd470682481e8cf01ddafe) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:11.494682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.496101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.501707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 231/451] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/role_assignments?group.id=1eba3cdba9574aa3892f6d53c2b10feb&scope.project.id=3c10c7d278dd470682481e8cf01ddafe&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.502503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.589369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0a95b-de47-4b9b-b99a-fcf8fe374508 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.607197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280a922-9f8e-44ed-8a65-d0cfc60686f0 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.623542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.624208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.624492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.624772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.625621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=610442154bc84cae961360db5432b95b, scope.project.id=ca6dc7889e0142a289dff26d0208210e) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:11.625936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.627549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.646128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 221/452] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=610442154bc84cae961360db5432b95b => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.655564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.656460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.656743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.657017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] PATH_INFO: `/v3/projects/ca6dc7889e0142a289dff26d0208210e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.658546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] RBAC: Authorizing `identity:get_project(project_id=ca6dc7889e0142a289dff26d0208210e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.660049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.661909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 232/453] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/projects/ca6dc7889e0142a289dff26d0208210e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.667827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.781502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df00676-ebd8-4f1b-84e5-4db26881c8b6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.817242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc8541-8644-4478-a718-ffd0edd60ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.818110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc8541-8644-4478-a718-ffd0edd60ee3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.818412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc8541-8644-4478-a718-ffd0edd60ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.818685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc8541-8644-4478-a718-ffd0edd60ee3 None admin] PATH_INFO: `/v3/groups/d80dde7b0348482abc23e19e3671c025` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.820238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc8541-8644-4478-a718-ffd0edd60ee3 None admin] RBAC: Authorizing `identity:get_group(group_id=d80dde7b0348482abc23e19e3671c025)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.821661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc8541-8644-4478-a718-ffd0edd60ee3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.823372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 222/454] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/groups/d80dde7b0348482abc23e19e3671c025 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:11.829427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:11.926826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a02e9-94a9-4035-b7fe-f47a20a8be3b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:11.960122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93ff96-5e18-4765-a83f-55d38afb8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:11.960769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ff96-5e18-4765-a83f-55d38afb8911 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:11.961052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ff96-5e18-4765-a83f-55d38afb8911 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:11.961324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ff96-5e18-4765-a83f-55d38afb8911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:11.962201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ff96-5e18-4765-a83f-55d38afb8911 None admin] RBAC: Adding query filter params (group.id=d80dde7b0348482abc23e19e3671c025, role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=ca6dc7889e0142a289dff26d0208210e) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:11.962514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ff96-5e18-4765-a83f-55d38afb8911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:11.963968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ff96-5e18-4765-a83f-55d38afb8911 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:11.969827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 233/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Mar 24 14:40:11 2022] GET /identity/v3/role_assignments?group.id=d80dde7b0348482abc23e19e3671c025&scope.project.id=ca6dc7889e0142a289dff26d0208210e&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:14.869033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8418-4c41-4f1a-b6ed-574e4175c8ec None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:14.870054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8418-4c41-4f1a-b6ed-574e4175c8ec None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:14.870557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca8418-4c41-4f1a-b6ed-574e4175c8ec None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:14.872830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 223/456] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:14.878212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ce5a-8f5e-478c-ac39-40e497ec8aec None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:14.878663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ce5a-8f5e-478c-ac39-40e497ec8aec None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:14.878762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44ce5a-8f5e-478c-ac39-40e497ec8aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:14.903229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ad44ce5a-8f5e-478c-ac39-40e497ec8aec None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:14.904428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ad44ce5a-8f5e-478c-ac39-40e497ec8aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:14.980407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 234/457] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:15.027323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca8418-4c41-4f1a-b6ed-574e4175c8ec None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.077153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361f17-73d0-4a98-a018-cda59b9dab4e None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.077866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361f17-73d0-4a98-a018-cda59b9dab4e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.078309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361f17-73d0-4a98-a018-cda59b9dab4e None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.081629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 235/458] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:15.087943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb17062-c945-4c66-bf6d-d9d18992ec7a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.088393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb17062-c945-4c66-bf6d-d9d18992ec7a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.088802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb17062-c945-4c66-bf6d-d9d18992ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.127241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-6bb17062-c945-4c66-bf6d-d9d18992ec7a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:15.128622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6bb17062-c945-4c66-bf6d-d9d18992ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:15.148591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca8418-4c41-4f1a-b6ed-574e4175c8ec None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.210799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.211604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.211876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.212145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.230369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.231815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:15.258661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 236/459] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:15.261405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:15.263041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 224/460] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:15.268554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb17062-c945-4c66-bf6d-d9d18992ec7a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.286033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.371492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb17062-c945-4c66-bf6d-d9d18992ec7a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.405573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9b577-e836-4e70-851f-0707e1b34f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.406507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b577-e836-4e70-851f-0707e1b34f96 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.406943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b577-e836-4e70-851f-0707e1b34f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.407347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b577-e836-4e70-851f-0707e1b34f96 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.408255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9b577-e836-4e70-851f-0707e1b34f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:15.408691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9b577-e836-4e70-851f-0707e1b34f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.409427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d81cd-a768-44e6-8a47-ab1d9519e696 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.410225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9b577-e836-4e70-851f-0707e1b34f96 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:15.429745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 237/461] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:15.431363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f579b6-7021-4e02-a0f0-1e8c4afddd36 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.431789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f579b6-7021-4e02-a0f0-1e8c4afddd36 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.432200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f579b6-7021-4e02-a0f0-1e8c4afddd36 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.434414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 238/462] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:15.435218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f579b6-7021-4e02-a0f0-1e8c4afddd36 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.448698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048366b8-ed4c-4791-90de-5d3b2c6ac616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.449715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048366b8-ed4c-4791-90de-5d3b2c6ac616 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.450177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048366b8-ed4c-4791-90de-5d3b2c6ac616 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.450610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048366b8-ed4c-4791-90de-5d3b2c6ac616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.461358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048366b8-ed4c-4791-90de-5d3b2c6ac616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.462995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048366b8-ed4c-4791-90de-5d3b2c6ac616 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:15.479789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-048366b8-ed4c-4791-90de-5d3b2c6ac616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:15.481524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 225/463] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:15.482891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318132-0c41-401b-ada7-015953b9dd81 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.483311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318132-0c41-401b-ada7-015953b9dd81 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.483720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318132-0c41-401b-ada7-015953b9dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.501028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-15318132-0c41-401b-ada7-015953b9dd81 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:15.502504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-15318132-0c41-401b-ada7-015953b9dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:15.549097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f579b6-7021-4e02-a0f0-1e8c4afddd36 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.567330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 226/464] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:15.568434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318132-0c41-401b-ada7-015953b9dd81 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.583806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.584755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.585199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.585637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.586589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.588285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:15.611113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 239/465] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:40:15 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:15.617166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.672383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318132-0c41-401b-ada7-015953b9dd81 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.709167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.709995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.710390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.710734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.711561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:15.711938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.713457 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:15.727820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 227/466] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:15.735857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.750602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1eb99-aa83-4cec-8f3e-a35adb9cc4eb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.789046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e10c5-a63a-4639-acc2-9bbac827aeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.790269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e10c5-a63a-4639-acc2-9bbac827aeb0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.790690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e10c5-a63a-4639-acc2-9bbac827aeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.791423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e10c5-a63a-4639-acc2-9bbac827aeb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.803692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e10c5-a63a-4639-acc2-9bbac827aeb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.805552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e10c5-a63a-4639-acc2-9bbac827aeb0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:15.824458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-fa6e10c5-a63a-4639-acc2-9bbac827aeb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:15.826271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 240/467] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:15.827723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513315d3-15b4-4d99-84a1-10788f30a2ec None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.828229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513315d3-15b4-4d99-84a1-10788f30a2ec None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.828725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513315d3-15b4-4d99-84a1-10788f30a2ec None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.831094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 241/468] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:15.833378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513315d3-15b4-4d99-84a1-10788f30a2ec None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:15.886609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ef19-39f5-4c53-8faf-c05bbcb342e8 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.926540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cb6fa-9a7f-463b-b058-9205eda62ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.927467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cb6fa-9a7f-463b-b058-9205eda62ab9 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.927889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cb6fa-9a7f-463b-b058-9205eda62ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.928366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cb6fa-9a7f-463b-b058-9205eda62ab9 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.929095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cb6fa-9a7f-463b-b058-9205eda62ab9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.931054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cb6fa-9a7f-463b-b058-9205eda62ab9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:15.947221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513315d3-15b4-4d99-84a1-10788f30a2ec None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:15.952889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 228/469] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:40:15 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:15.954201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b69c-f4e9-4b4b-802e-7cb1e092306f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.954540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b69c-f4e9-4b4b-802e-7cb1e092306f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.955198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b69c-f4e9-4b4b-802e-7cb1e092306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.977945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ab55b69c-f4e9-4b4b-802e-7cb1e092306f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:15.979543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ab55b69c-f4e9-4b4b-802e-7cb1e092306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:15.990293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:15.991070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:15.991358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:15.991688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:15.992423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:15.992781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:15.994341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:16.008999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 242/470] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:16.017311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:16.086241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 229/471] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:16.092831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d4b6d-099e-4118-b3ae-317f8f477a3b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.093114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d4b6d-099e-4118-b3ae-317f8f477a3b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.093386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d4b6d-099e-4118-b3ae-317f8f477a3b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.099500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 230/472] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:16.100961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cb9f8-8ad0-481a-9e37-b761e39f5710 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.101246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cb9f8-8ad0-481a-9e37-b761e39f5710 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.101518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cb9f8-8ad0-481a-9e37-b761e39f5710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.118746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-895cb9f8-8ad0-481a-9e37-b761e39f5710 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:16.119931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-895cb9f8-8ad0-481a-9e37-b761e39f5710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:16.166300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90295b-d9d4-4426-8f77-f4e767edb238 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:16.207498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:16.207707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.208060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.208159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.210416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:16.211853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:16.217924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 231/473] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:16.218882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cb9f8-8ad0-481a-9e37-b761e39f5710 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:16.234651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 243/474] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:40:16 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:16.252039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:16.340782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cb9f8-8ad0-481a-9e37-b761e39f5710 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:16.363474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd325-0714-4b8c-96f5-65e4c2a11af5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:16.376631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:16.377598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.377881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.378183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.389288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:16.390837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:16.400688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:16.401377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.401661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.401937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.402725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:16.404123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:16.411155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:16.412560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 232/475] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:16.420932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:16.421590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.sql.core [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 24 14:40:16.421590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 24 14:40:16.421590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [parameters: {'id': 'b1f46f38faf148d2b4a4cd8262ce282b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 24 14:40:16.421590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 24 14:40:16.446566 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 24 14:40:16.447990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 244/476] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Mar 24 14:40:16 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:16.453782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:16.539948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60c72e-7c15-4a15-b4db-303ab729cb56 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:16.564382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816239-3589-47b2-b61f-94a4c2dcdfe3 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:16.581139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:16.581803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.582098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.582592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.583272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:16.583870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:16.585234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:16.597951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 233/477] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:16.604572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:16.618512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:16.619974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.620646 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.621395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.634770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:16.644065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 24 14:40:16.646654 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 245/478] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:16.655223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:16.719809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788061a-ec02-4389-ba99-865b82c1bab5 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:16.763396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5deea-9e48-4b6f-91e5-fd60dc3d507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:16.764068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5deea-9e48-4b6f-91e5-fd60dc3d507c None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.764402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5deea-9e48-4b6f-91e5-fd60dc3d507c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.764614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5deea-9e48-4b6f-91e5-fd60dc3d507c None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.765708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5deea-9e48-4b6f-91e5-fd60dc3d507c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:16.767543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5deea-9e48-4b6f-91e5-fd60dc3d507c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:16.778362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d868c87-f4bb-49be-946f-496269312a78 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:16.794982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 234/479] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:40:16 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:16.817603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e03415-e828-4d88-8852-010e2c609945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:16.818330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03415-e828-4d88-8852-010e2c609945 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:16.818670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03415-e828-4d88-8852-010e2c609945 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:16.818950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e03415-e828-4d88-8852-010e2c609945 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:16.819723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e03415-e828-4d88-8852-010e2c609945 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:16.820027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e03415-e828-4d88-8852-010e2c609945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:16.821511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e03415-e828-4d88-8852-010e2c609945 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:16.831959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 246/480] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:18.702347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5a58-f6ff-4f72-9c27-6a718d6408a3 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:18.703368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5a58-f6ff-4f72-9c27-6a718d6408a3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:18.703851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5a58-f6ff-4f72-9c27-6a718d6408a3 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:18.706504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 235/481] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:18.711419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940acd7-ef33-4bc8-9073-62a58d2c97d5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:18.711852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940acd7-ef33-4bc8-9073-62a58d2c97d5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:18.712019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940acd7-ef33-4bc8-9073-62a58d2c97d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:18.736302 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-4940acd7-ef33-4bc8-9073-62a58d2c97d5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:18.737505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4940acd7-ef33-4bc8-9073-62a58d2c97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:18.799534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db981de-ab08-44a1-953a-c94e18606dea None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:18.800185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db981de-ab08-44a1-953a-c94e18606dea None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:18.800655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db981de-ab08-44a1-953a-c94e18606dea None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:18.802914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 236/482] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:18.807514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b440-f638-4539-9672-01f6c25b28f7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:18.807804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b440-f638-4539-9672-01f6c25b28f7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:18.808186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9b440-f638-4539-9672-01f6c25b28f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:18.809531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 247/483] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:18.832705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940acd7-ef33-4bc8-9073-62a58d2c97d5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:18.843075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-55a9b440-f638-4539-9672-01f6c25b28f7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:18.844254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-55a9b440-f638-4539-9672-01f6c25b28f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:18.933210 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940acd7-ef33-4bc8-9073-62a58d2c97d5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:18.967702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:18.968423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:18.968864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:18.969295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:18.981232 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:18.990437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:18.992369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 248/484] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:18.995620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 237/485] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:19.009331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.022687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b440-f638-4539-9672-01f6c25b28f7 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.119652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b69559-147f-4a7f-9cf0-1292bb589f99 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.153266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.154540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.155185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.155672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.156623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:19.157120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:19.158781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:19.167716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 249/486] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:19.182108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.234011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9b440-f638-4539-9672-01f6c25b28f7 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.290668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be76bf-3986-4534-8d46-ed2d0d2ae80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.291494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be76bf-3986-4534-8d46-ed2d0d2ae80f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.291779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be76bf-3986-4534-8d46-ed2d0d2ae80f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.292053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be76bf-3986-4534-8d46-ed2d0d2ae80f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.302748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be76bf-3986-4534-8d46-ed2d0d2ae80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:19.309833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-90be76bf-3986-4534-8d46-ed2d0d2ae80f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:19.311463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 238/487] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:19.312685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e631-eca8-4e3c-b6d8-4b72ee5b1a18 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.312968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e631-eca8-4e3c-b6d8-4b72ee5b1a18 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.313260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667e631-eca8-4e3c-b6d8-4b72ee5b1a18 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.319137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 239/488] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:19.319947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667e631-eca8-4e3c-b6d8-4b72ee5b1a18 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.325376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e75920-ec2c-4258-9574-6de19a3a69ea None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.359553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5692-0299-4c70-88e2-7d379c47b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.360935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5692-0299-4c70-88e2-7d379c47b732 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.362267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5692-0299-4c70-88e2-7d379c47b732 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.362751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5692-0299-4c70-88e2-7d379c47b732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.376084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5692-0299-4c70-88e2-7d379c47b732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:19.378403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5692-0299-4c70-88e2-7d379c47b732 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:19.401161 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-064b5692-0299-4c70-88e2-7d379c47b732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:19.403217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 250/489] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:19.405508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46595-1838-41b9-ad0f-f9661162d4f7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.406051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46595-1838-41b9-ad0f-f9661162d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.406581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46595-1838-41b9-ad0f-f9661162d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.428705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3af46595-1838-41b9-ad0f-f9661162d4f7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:19.429938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3af46595-1838-41b9-ad0f-f9661162d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:19.438723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667e631-eca8-4e3c-b6d8-4b72ee5b1a18 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.481498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.482368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.482478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.482743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.483499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:19.483807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:19.485299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:19.493901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 240/490] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:19.494880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.515032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 251/491] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:19.516243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af46595-1838-41b9-ad0f-f9661162d4f7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.613324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968dc1-8cb7-43c2-83d0-d00821982784 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.631162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af46595-1838-41b9-ad0f-f9661162d4f7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.645783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.646540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.646824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.647101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.647838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:19.648145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:19.649530 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:19.662495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 241/492] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:19.663354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.680012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.681553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.682039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.682562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.696419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:19.697893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:19.715247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:19.716513 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 252/493] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:19.717303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.779262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd02e4-5f9f-4d5f-be46-d4f401960b4e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.811518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.812342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.812632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.812908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.816174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1048998-07eb-4eab-8b55-0f427e036caa None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.822814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:19.830145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:19.831337 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 242/494] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:19.832100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.848185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d55fa-9cfd-47a5-9d2b-bf6dbe93bc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.848966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d55fa-9cfd-47a5-9d2b-bf6dbe93bc12 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.849240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d55fa-9cfd-47a5-9d2b-bf6dbe93bc12 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.849507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d55fa-9cfd-47a5-9d2b-bf6dbe93bc12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.856267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d55fa-9cfd-47a5-9d2b-bf6dbe93bc12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:19.857693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d55fa-9cfd-47a5-9d2b-bf6dbe93bc12 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:19.870832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ff6d55fa-9cfd-47a5-9d2b-bf6dbe93bc12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:40:19.871975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 253/495] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:19.873140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac2e3e-9900-4b88-9f43-6f6060f371fe None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.873424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac2e3e-9900-4b88-9f43-6f6060f371fe None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.873689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac2e3e-9900-4b88-9f43-6f6060f371fe None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.876698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 254/496] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:19.877888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5207-4bf0-4193-89af-aeecac8cac68 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.878207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5207-4bf0-4193-89af-aeecac8cac68 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.878474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5207-4bf0-4193-89af-aeecac8cac68 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.880096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 255/497] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:19.880780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea5207-4bf0-4193-89af-aeecac8cac68 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.924896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4b7b-5dd2-486d-bad4-a797c3f0c427 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:19.958272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:19.958931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:19.959225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:19.959490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:19.960204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:19.960505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:19.961864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:19.973103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 243/498] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:19.973957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:19.978492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea5207-4bf0-4193-89af-aeecac8cac68 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.012043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913987b-7f4e-4fb1-9009-0cf32e4ab21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.012703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913987b-7f4e-4fb1-9009-0cf32e4ab21e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.012991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913987b-7f4e-4fb1-9009-0cf32e4ab21e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.013265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913987b-7f4e-4fb1-9009-0cf32e4ab21e None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.014007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913987b-7f4e-4fb1-9009-0cf32e4ab21e None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:20.014344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913987b-7f4e-4fb1-9009-0cf32e4ab21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.015718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913987b-7f4e-4fb1-9009-0cf32e4ab21e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.023377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 256/499] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:20.024519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b560ad8-3c08-468d-8e73-d64a4f119930 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.024802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b560ad8-3c08-468d-8e73-d64a4f119930 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.025107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b560ad8-3c08-468d-8e73-d64a4f119930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.043489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1b560ad8-3c08-468d-8e73-d64a4f119930 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:20.044572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1b560ad8-3c08-468d-8e73-d64a4f119930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:20.069329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130688-f604-4306-914b-eb61a54fa33f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.102104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.102780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.103059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.103329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.104153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:20.104461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.105772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 257/500] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:20.105877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.107062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0efea-f66e-4c8d-a116-9a7b8d7d66b7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.107354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0efea-f66e-4c8d-a116-9a7b8d7d66b7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.107630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0efea-f66e-4c8d-a116-9a7b8d7d66b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.122842 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-68f0efea-f66e-4c8d-a116-9a7b8d7d66b7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:20.123977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-68f0efea-f66e-4c8d-a116-9a7b8d7d66b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:20.155913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 244/501] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:40:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:20.158988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.190119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 258/502] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:20.190961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0efea-f66e-4c8d-a116-9a7b8d7d66b7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.256736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdac35-fddb-40d0-a06d-db60cb2041eb None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.285140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0efea-f66e-4c8d-a116-9a7b8d7d66b7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.289312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.290109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.290412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.290688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.297631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.299109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.312452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 24 14:40:20.313597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 245/503] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:20.318215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.323350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.324143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.324422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.324695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.334962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.336411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.352551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:20.353712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 259/504] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:20.355551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.408722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbafaab-403f-457c-ab84-eb07d38bf688 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.444126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.444919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.445199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.445469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.453372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3bc98-43d2-4105-81c8-794c6b463e25 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.456054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:20.462967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:20.464302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 246/505] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:20.464898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.488570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.489217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.489505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.489784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.553072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.554520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.559754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd95b7-be84-431d-b69a-0cb46a5f249a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.591903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.592681 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.592960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.593231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.603823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.605238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.621126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:20.622290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 247/506] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:20.623039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.654723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 260/507] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:20.654723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.725930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251c7e-6d85-47e1-b1b8-135aa5049fe5 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.745367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ed7cb-b58a-4213-b608-c9c737eced36 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.758769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.759433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.759719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.759996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.760839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:20.761149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.762608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.777407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.778054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.778364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.778642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.779334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 248/508] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:20.779768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:20.779768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.780121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.781067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.792400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 261/509] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:20.793194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.871916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fdbeb-2ccc-4107-b28f-a37f98a359ab None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.887815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0279ae-9674-44d7-8210-5991462876ca None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:20.904545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.905208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.905487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.905758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.906561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:20.906864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.908288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.915948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 249/510] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:20.916709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:20.923776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:20.924445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:20.924725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:20.925001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:20.925721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:20.926026 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:20.927452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:20.939062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 262/511] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:20.939878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.013743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c897a22-1402-401e-8e83-a1cf40296215 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.036735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c4654-4a5b-40c2-a7de-55eacf192f9e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.045621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.046453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.046733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.047012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.057173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.058659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.071716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.072352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.072634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.072914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.074354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:21.075680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 250/512] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:21.076291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.136125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.137492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.174165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859bea-ac72-4f69-9c5c-bbd1b1bc8cbf None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.206095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.206892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.207165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.207437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.214716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.216141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.229032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 24 14:40:21.230190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 251/513] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:21.235260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 263/514] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:21.235393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.235479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.327792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55699a-70e9-45d7-93c8-97e80902b00b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.330890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a16bc-6e16-448c-bf88-6b3211e389d7 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.361294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.362043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.362354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.362625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.362722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.363283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.363563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.363837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.364555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.365980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.373422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.374877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.386595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 264/515] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:40:21 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:21.387395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.391788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:21.397719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 252/516] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:21.397719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.499804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc5c38-05a7-47ab-9fd8-f09b0d87e662 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.504317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e55a3-2b4d-467c-9825-4f4c89091bc1 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.538346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.538716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.539034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.539318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.539432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.539596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.539744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.539990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.540326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:21.540634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.540839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:21.541149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.542029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.542658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.554888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 265/517] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:21.555758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.562194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 253/518] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:21.563035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.661592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144d93a-62b1-4c50-a318-343477344285 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.669835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e3596-563f-450c-b395-bcdef824a5ff None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.694467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.695128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.695409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.695682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.696406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:21.696711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.698067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.702166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.702960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.703242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.703515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.713503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 254/519] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:21.713503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.717797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.719317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.736718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:21.742207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 266/520] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:21.742207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.804843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e364-5d0f-4a73-9f4f-d38436746006 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.836799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.837134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb11069-9055-44c7-9981-67d05d861955 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.837629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.837867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.838166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.844623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.846120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.860199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:21.866245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 255/521] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:21.867109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:21.875896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:21.876582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:21.876871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:21.877325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:21.943747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:21.945279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:21.961983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd271e52-742f-4cef-a0c4-3ce6f67734fd None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:21.998994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.000232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.000751 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.001046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.010603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.012071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.025929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 24 14:40:22.031640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 256/522] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:22.031640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.042879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 267/523] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:22.043936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.131094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042427-09fe-4e6f-ae83-b865dc478c8f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.136175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c192a-d703-4cef-9aae-9e36870fb6a2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.164882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.165813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.166295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.166756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.167658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:22.168130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.168523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.169186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.169470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.169746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.170438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.170538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:22.170849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.172265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.186260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 257/524] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:22.187325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.189875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 268/525] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:22.190605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.286978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1118b-f305-4b8d-b8ed-0b1c2b8b5853 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.287169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3e4e-12a4-4334-8985-c879942881a4 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.319333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.319529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.319998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.320099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.320283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.320374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.320562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.320653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.321406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:22.321714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.323185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.331015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.332431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.340788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 258/526] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:22.341621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.353953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:22.355276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 269/527] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:22.356028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.444466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22ca12-83d5-4f4d-882d-b07c3f370373 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.451530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752a0bb-da7e-471b-8e25-5dd35933e65b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.478304 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.479104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.479391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.479664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.486399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.486759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.487596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.487838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.488220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.488672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.489656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=1cc15d4ea22b441ab70b958fba26a07f) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:22.490168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.491618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.500904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:22.507005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 259/528] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:22.507005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.507256 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 270/529] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/role_assignments?user.id=1cc15d4ea22b441ab70b958fba26a07f&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:22.507256 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.635098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1ca9f-6e7a-43bd-8bb2-bcbdeb55c639 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.640917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfd101-5d15-42a4-9a2a-fc37d5101ca2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.670939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.671999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.672497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.672990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.677357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.678129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.678589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.679062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.680053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:22.680589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.682192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.695772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 271/530] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:22.696693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.745029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.746609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.804823 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20971f0-9aa7-4717-8512-cd01a4630707 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.838459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.839929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.840435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.840905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.841886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:22.842412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.844107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.846183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 260/531] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:22.847110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.858495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 272/532] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:22.859602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:22.943658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee27625-97cd-48e5-9d15-334619a47e14 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.958349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4f8a3-f38d-481f-abd1-d9a1216533a8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:22.978031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.979079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.979372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.979654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:22.987203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:22.988646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:22.993815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:22.994941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:22.995439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:22.995904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.001584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:23.003244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 261/533] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:23.004022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:23.007154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.008938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.026432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:23.028236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 273/534] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:23.029193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:23.105433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c4d73-3c3f-44fa-930e-c406102570df None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:23.127471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b7eee-f161-42b6-8c2f-ae0018650c76 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:23.138028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:23.138736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.139018 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.139299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.140126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=9c6a3dbc0cbe4acc81a8691fc85c7352) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:23.140446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.141870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.147645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 262/535] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/role_assignments?user.id=9c6a3dbc0cbe4acc81a8691fc85c7352&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:23.148550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:23.167211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:23.168274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.168757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.169229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.170303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:23.170833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.172635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.186064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 274/536] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:23.195266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:23.272438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10333b-a10e-47c3-8455-dc8252cb3785 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:23.310674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:23.311775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.312060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.312337 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.313371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:23.313679 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.315515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.340145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 263/537] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:23.349301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:23.412888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abc5b9-8c80-4044-9bad-dce82d097094 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:23.446733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:23.447185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.447465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.447738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.448565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=6c290be79dec4fe8b10bc04e691c00b1) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:23.448871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.450458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.457611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 275/538] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/role_assignments?user.id=6c290be79dec4fe8b10bc04e691c00b1&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:23.485632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e340094-00f2-46dc-a134-825ee517378f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:23.526466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e112c5-9cf0-4a69-985b-84ae8aba81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:23.527295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e112c5-9cf0-4a69-985b-84ae8aba81ec None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.527578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e112c5-9cf0-4a69-985b-84ae8aba81ec None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.527858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e112c5-9cf0-4a69-985b-84ae8aba81ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.537501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e112c5-9cf0-4a69-985b-84ae8aba81ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.539009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e112c5-9cf0-4a69-985b-84ae8aba81ec None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.556030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-76e112c5-9cf0-4a69-985b-84ae8aba81ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:23.557438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 264/539] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:23.563396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:23.696144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5edea-6f39-4e45-a8fd-ee214e51a4d5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:23.736732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf55b-f6cb-42da-a5b7-bbaceb0e84ee None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.737010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf55b-f6cb-42da-a5b7-bbaceb0e84ee None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.737208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf55b-f6cb-42da-a5b7-bbaceb0e84ee None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.739136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 265/540] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:23.739442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:23.740115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.740394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.740669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.741583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:23.741889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.743406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.753117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cb86b-3180-4b46-a292-9a2d1051ee28 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.753411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cb86b-3180-4b46-a292-9a2d1051ee28 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.753699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cb86b-3180-4b46-a292-9a2d1051ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.756660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 276/541] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:23.772176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:23.787800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-9e9cb86b-3180-4b46-a292-9a2d1051ee28 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:23.788987 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-9e9cb86b-3180-4b46-a292-9a2d1051ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:23.883220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd42a9-11db-4380-9a46-445d5ca64646 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:23.891771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 266/542] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:23.921623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:23.922324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:23.922607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:23.922882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:23.923745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=750a6a7b35204c47ac16a584e7e71713) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:23.924055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:23.925496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:23.932011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 277/543] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/role_assignments?user.id=750a6a7b35204c47ac16a584e7e71713&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:23.938950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cb86b-3180-4b46-a292-9a2d1051ee28 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:24.042687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cb86b-3180-4b46-a292-9a2d1051ee28 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:24.085453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:24.086305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:24.086589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:24.086867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:24.104024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:24.111233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:24.112804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 267/544] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:24.118818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:24.259812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308e652-4b0b-4dcd-a6e2-bf61ce380273 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:24.311411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:24.312012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:24.312299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:24.312577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:24.313330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:24.313637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:24.315111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:24.323533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 278/545] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:24.329313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:24.445672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac307ccd-a697-419b-8bab-1257bc5443b2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:24.499333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:24.500492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:24.500981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:24.501434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:24.512374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:24.514106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:24.534395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:24.536169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 268/546] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:24.541403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:24.703819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3da65-7439-4e48-b3fd-b2b2c2d54dc5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:24.754984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:24.755676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:24.755961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:24.756241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:24.756981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:24.757290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:24.758701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:24.771042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 279/547] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:24.776168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:24.888565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22697ee-1e27-40f4-a962-173ba9568727 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:24.921923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:24.922757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:24.923044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:24.923322 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:24.931113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:24.932565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:24.945856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 24 14:40:24.947447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 269/548] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:24.955637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:25.083846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade18d6f-fe61-4d96-b28b-856248462ddc None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:25.131353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153065-abe6-470f-aee2-6f8e9bd26cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:25.132024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153065-abe6-470f-aee2-6f8e9bd26cc3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.132309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153065-abe6-470f-aee2-6f8e9bd26cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.132584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153065-abe6-470f-aee2-6f8e9bd26cc3 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.133415 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e153065-abe6-470f-aee2-6f8e9bd26cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:25.133722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e153065-abe6-470f-aee2-6f8e9bd26cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:25.135190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e153065-abe6-470f-aee2-6f8e9bd26cc3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:25.181859 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 280/549] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Mar 24 14:40:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:25.187077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:25.287516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40ba2a-1e6d-4560-a31c-96fdb5fecfa1 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:25.325613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:25.326349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.326636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.326920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.374700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858484a5-1406-4e36-be48-154fb2395653 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.375005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858484a5-1406-4e36-be48-154fb2395653 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.375254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858484a5-1406-4e36-be48-154fb2395653 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.377266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 281/550] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:25.382497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964eb72-8906-437d-a126-85817fe85a43 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.382785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964eb72-8906-437d-a126-85817fe85a43 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.383065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964eb72-8906-437d-a126-85817fe85a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.407480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:25.409107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:25.416237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-0964eb72-8906-437d-a126-85817fe85a43 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:25.417445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0964eb72-8906-437d-a126-85817fe85a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:25.509747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 270/551] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:25.515947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:25.572328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 282/552] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:25.617487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52310e-822d-4474-8e41-9c1f30c444f6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:25.619475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964eb72-8906-437d-a126-85817fe85a43 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:25.657630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:25.658500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.658784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.659061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.674209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:25.675664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:25.700938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:25.702473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 271/553] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:25.708320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:25.730328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964eb72-8906-437d-a126-85817fe85a43 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:25.772784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:25.773656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.773937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.774279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.795877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:25.811441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:25.813109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 283/554] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:25.818926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:25.830149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c053bf-76f7-492a-abfa-c2ebaa73309d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:25.879770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:25.880443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.880724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.881001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.881739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:25.882046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:25.883446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:25.907867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 272/555] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:25.907867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:25.942143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b12a8-33c4-438e-a842-449329f334c6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:25.984276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:25.985019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:25.985237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:25.985514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:25.986327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:25.986637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:25.988042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.004906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 284/556] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:26.010309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.017675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c0cc4-bd29-4901-afea-eef022f60724 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.053998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.055726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.056016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.056294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.067647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.069112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.093595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:26.095070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 273/557] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:26.102325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.191758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a1ac7-1711-44b0-b587-77e0740d3a0a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.230673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b05ebf-820c-4e44-9443-c0ad5a834b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.231466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b05ebf-820c-4e44-9443-c0ad5a834b7f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.231744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b05ebf-820c-4e44-9443-c0ad5a834b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.232008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b05ebf-820c-4e44-9443-c0ad5a834b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.237964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428a267-eb9a-416c-a25d-59caefa412e3 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.243873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b05ebf-820c-4e44-9443-c0ad5a834b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.245365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b05ebf-820c-4e44-9443-c0ad5a834b7f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.262170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-80b05ebf-820c-4e44-9443-c0ad5a834b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:26.266463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 285/558] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:26.266463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acda7-a119-45f9-936d-a9fb3fe70308 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.266463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acda7-a119-45f9-936d-a9fb3fe70308 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.266463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acda7-a119-45f9-936d-a9fb3fe70308 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.270218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 286/559] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:26.272021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c9ed-417b-48eb-9e0a-9a5fd3f4d180 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.272306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c9ed-417b-48eb-9e0a-9a5fd3f4d180 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.272578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c9ed-417b-48eb-9e0a-9a5fd3f4d180 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.274235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 287/560] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:26.276345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d7ec5-12a2-43c6-a4d1-470b55e5a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.277248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d7ec5-12a2-43c6-a4d1-470b55e5a110 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.277722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d7ec5-12a2-43c6-a4d1-470b55e5a110 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.278198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d7ec5-12a2-43c6-a4d1-470b55e5a110 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.279015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c9ed-417b-48eb-9e0a-9a5fd3f4d180 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.279399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d7ec5-12a2-43c6-a4d1-470b55e5a110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:26.279878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d7ec5-12a2-43c6-a4d1-470b55e5a110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.281575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d7ec5-12a2-43c6-a4d1-470b55e5a110 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.304348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 274/561] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:26.305677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f8665-b049-470c-bc9a-1fffc538fbc0 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.305969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f8665-b049-470c-bc9a-1fffc538fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.306268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f8665-b049-470c-bc9a-1fffc538fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.322338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-be1f8665-b049-470c-bc9a-1fffc538fbc0 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:26.323522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-be1f8665-b049-470c-bc9a-1fffc538fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:26.379238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c9ed-417b-48eb-9e0a-9a5fd3f4d180 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.388990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 275/562] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:26.390349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da0cd-3387-4124-9367-a78109557e25 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.390669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da0cd-3387-4124-9367-a78109557e25 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.390956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da0cd-3387-4124-9367-a78109557e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.408463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2c1da0cd-3387-4124-9367-a78109557e25 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:26.409801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2c1da0cd-3387-4124-9367-a78109557e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:26.428173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.428844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.429129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.429405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.430147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:26.430458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.431849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.448025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 288/563] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:26.448025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.477524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 276/564] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:26.479052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1da0cd-3387-4124-9367-a78109557e25 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.549105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02f044-68e2-4b13-9001-9f6e7773a492 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.579223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1da0cd-3387-4124-9367-a78109557e25 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.582092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.582765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.583046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.583322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.584142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=58d77195060b4aeb8a9bfcef2dd147fd) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:26.584449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.585889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.591367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 289/565] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/role_assignments?user.id=58d77195060b4aeb8a9bfcef2dd147fd&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:26.592153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.629842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.630632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.630913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.631186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.646183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:26.655473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:26.658251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 277/566] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:26.659379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.720761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6e8ef-a14f-41c6-837e-3726d45ebeb6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.764857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.765657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.765935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.766247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.768520 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a22ce8-a16a-411f-b384-07e1967cde20 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.773882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.775399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.789464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:40:26.790698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 290/567] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:26.791466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.805875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69ef1f-6fce-4dac-a854-5bf053bc43c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.806711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69ef1f-6fce-4dac-a854-5bf053bc43c2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.806992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69ef1f-6fce-4dac-a854-5bf053bc43c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.807267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69ef1f-6fce-4dac-a854-5bf053bc43c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.817269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69ef1f-6fce-4dac-a854-5bf053bc43c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:26.824145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-ac69ef1f-6fce-4dac-a854-5bf053bc43c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:26.825336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 278/568] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:26.826588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e982a-87b7-4c0c-82d5-f520957e5c3f None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.826871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e982a-87b7-4c0c-82d5-f520957e5c3f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.827147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e982a-87b7-4c0c-82d5-f520957e5c3f None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.829106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 279/569] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:26.830191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e982a-87b7-4c0c-82d5-f520957e5c3f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.892587 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ae788-28e1-4849-b4e0-6799dbf155a2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.925146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.925897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.926120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.926382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.927122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:26.927423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.928786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.931629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e982a-87b7-4c0c-82d5-f520957e5c3f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:26.941448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 291/570] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:26.941448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:26.964353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a47ca-7143-4d61-a655-e006c0677eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:26.965017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a47ca-7143-4d61-a655-e006c0677eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.965293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a47ca-7143-4d61-a655-e006c0677eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.965560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a47ca-7143-4d61-a655-e006c0677eb5 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:26.966429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a47ca-7143-4d61-a655-e006c0677eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:26.966734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a47ca-7143-4d61-a655-e006c0677eb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:26.968153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a47ca-7143-4d61-a655-e006c0677eb5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:26.990620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 280/571] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:26.990620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d581-e1d3-41f8-b42b-be722e97fb32 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:26.990620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d581-e1d3-41f8-b42b-be722e97fb32 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:26.990620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d581-e1d3-41f8-b42b-be722e97fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.006062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-74c1d581-e1d3-41f8-b42b-be722e97fb32 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:27.007270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-74c1d581-e1d3-41f8-b42b-be722e97fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:27.039794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd7a24-2493-4410-b551-2ab36cd136d0 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.079938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 281/572] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:27.079938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1d581-e1d3-41f8-b42b-be722e97fb32 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.083678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.084355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.084640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.084918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.085662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:27.085967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.087399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.095923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 292/573] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:27.096729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.163151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1d581-e1d3-41f8-b42b-be722e97fb32 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.191854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ee3a1-4736-4ade-a13c-8dcb5321e85e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.194113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.194929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.195197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.195471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.205351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.206837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.223055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:27.223911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.228814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 282/574] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:27.228960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.228960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.229118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.229198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.239767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.241213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.257150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:27.262960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 293/575] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:27.262960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.328485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada902-e7e9-4186-a0ba-dcf82dbfdaa2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.355941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1e9c-d625-463c-a785-378ce135fa02 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.365690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.366906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.367326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.367742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.381908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.383687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.394653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.395652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.395949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.396370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.401095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:27.402348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 283/576] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:27.403275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.410778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:27.417760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:27.419075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 294/577] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:27.419690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.503876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5506c-0bcb-42c3-869a-56d5ba390d47 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.517295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2eefd-0ec8-4b00-a6a4-050a112f1c92 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.535713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.536371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.536653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.536926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.537659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:27.537956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.539365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.548560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.549217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.549496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.549768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.550510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:27.550904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 284/578] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:27.551600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.555230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.556649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.568773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 295/579] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:27.569603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.657022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423573f-67c8-41e2-a309-0d2a19fc2953 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.663934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4ac9-f09e-4059-9359-be92966b4554 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.690211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.690788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.691070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.691339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.692053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:27.692360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.694510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.703529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.705337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.706195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.706646 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.707598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:27.707905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 285/580] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:27.708251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.708766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.710043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.722144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 296/581] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:27.723003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.808124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae24b4-6697-48cb-b817-6b21a2896c6d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.825152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8008-4a40-4355-b2d0-d8ca18b0295f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.840090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.840882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.841157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.841426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.848159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.849567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.858791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.859616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.859900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.860175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:27.868734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 24 14:40:27.868734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 286/582] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:27.868734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.869025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:27.869025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:27.883797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:27.889664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 297/583] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:27.889664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:27.962390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2efef0-a6a6-4fee-a2b3-bdeb827ea9ab None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.983639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39263d-6ea6-4728-946c-295004b134f4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:27.994293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:27.995084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:27.995367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:27.995642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.002524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.003961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.015483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.016350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.016690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.017052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.017181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 24 14:40:28.023117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 287/584] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:28.023117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.027589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.029091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.045527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:28.046797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 298/585] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:28.047495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.117101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fd952-23fc-4776-adba-ba7ad8a77df0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.147349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29754a-4bc5-40d4-a226-d301740c2706 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.149737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.150439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.150721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.151000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.151838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:28.152145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.153566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.170345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 288/586] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:28.171157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.187950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.188614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.188942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.189233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.190006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:28.190347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.191773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.208244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 299/587] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:28.208244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.266723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529856-8d79-4e4f-b87e-8142e1ef9b70 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.298851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.299514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.299787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab839bf-9b44-4ed2-b777-897d489e949e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.299887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.300056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.300876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:28.301184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.302640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.323165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 289/588] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:28.323165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.336424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.337094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.337376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.337828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.338393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:28.338698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.340058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.355972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 300/589] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:28.355972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.418502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4b18a-c2d5-462f-930f-af2fc3a0796a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.448405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462dd7-caba-4804-8a53-b6726ea79cb3 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.450156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.450961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.451234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.451501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.461562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.463016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.479298 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:28.485066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 290/590] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:28.485066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.487495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.488568 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.488850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.489120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/1cc15d4ea22b441ab70b958fba26a07f/roles/da56ace2cb7e42d29ebc9789d9f3c756` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.506631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=1cc15d4ea22b441ab70b958fba26a07f, role_id=da56ace2cb7e42d29ebc9789d9f3c756)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.508117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.530224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 301/591] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:28 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/1cc15d4ea22b441ab70b958fba26a07f/roles/da56ace2cb7e42d29ebc9789d9f3c756 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:28.530224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.622175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b916dc-d4ec-4fb3-bcff-6ec77c823355 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.627295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c998325-7b5d-427e-af21-324f5504a26e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.667131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.667347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.667940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.668217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.668488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.669039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.669515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.669989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.678335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.679733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.680426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.681185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.695980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 24 14:40:28.701994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:28.702631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 302/592] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:28.703052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 291/593] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:28.703871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.704168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.812958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4b0b-6d94-4c83-ad57-54981ba6f489 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.819403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e7ae8-b79d-4d35-8156-024735b50286 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.846355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.847020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.847300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.847574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.848406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:28.848708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.850138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.852923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.853592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:28.853873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:28.854175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:28.854895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:28.855202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:28.856555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:28.867948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 292/594] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:28.868269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 303/595] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:28.868802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.875062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:28.965255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f398-0eb3-4e09-9ea0-5e3fe9bc72f9 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.970604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e539e1b-7dd0-40d5-97d1-78c3818f45d2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:28.999184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:28.999844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.000124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.000392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.001110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:29.001475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.002875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.004362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5a78b-c4a6-44ba-9a8c-87ca1f5f7709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.005409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5a78b-c4a6-44ba-9a8c-87ca1f5f7709 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.005830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5a78b-c4a6-44ba-9a8c-87ca1f5f7709 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.006269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5a78b-c4a6-44ba-9a8c-87ca1f5f7709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.012973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5a78b-c4a6-44ba-9a8c-87ca1f5f7709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.013487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 293/596] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:29.014343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.014970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5a78b-c4a6-44ba-9a8c-87ca1f5f7709 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.031559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-bbe5a78b-c4a6-44ba-9a8c-87ca1f5f7709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:29.037504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 304/597] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:29.037504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4b98-aaa0-4d07-bd05-776a060cc586 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.037504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4b98-aaa0-4d07-bd05-776a060cc586 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.037504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4b98-aaa0-4d07-bd05-776a060cc586 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.037504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 305/598] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:29.037504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4b98-aaa0-4d07-bd05-776a060cc586 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.112502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535dd95-3215-4b45-a0ca-c5dff538cb6a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.138596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4b98-aaa0-4d07-bd05-776a060cc586 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.145260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.146048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.146354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.146626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.156850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.158573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.174418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb3359-5268-4406-aaa2-e81bf83e41be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.174550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:29.175216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb3359-5268-4406-aaa2-e81bf83e41be None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.175500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb3359-5268-4406-aaa2-e81bf83e41be None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.180116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 294/599] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:29.180227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb3359-5268-4406-aaa2-e81bf83e41be None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.180300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.186784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb3359-5268-4406-aaa2-e81bf83e41be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.188212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb3359-5268-4406-aaa2-e81bf83e41be None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.200961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-9ccb3359-5268-4406-aaa2-e81bf83e41be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:29.207162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 306/600] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:29.207162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778286b-274a-4a3f-b531-e0fdeeebe413 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.207162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778286b-274a-4a3f-b531-e0fdeeebe413 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.207162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778286b-274a-4a3f-b531-e0fdeeebe413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.222737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9778286b-274a-4a3f-b531-e0fdeeebe413 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:29.223913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9778286b-274a-4a3f-b531-e0fdeeebe413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:29.278957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2664-046e-49e1-b0bf-80f6ff330f39 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.294224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 307/601] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:29.295081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778286b-274a-4a3f-b531-e0fdeeebe413 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.326044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.326736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.327013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.327251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.328052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:29.328342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.330174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.344645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 295/602] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:29.345787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.396564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778286b-274a-4a3f-b531-e0fdeeebe413 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.429295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.429968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.430279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.430556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.431280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:29.431583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.432965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.449243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 308/603] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:29.449243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.456596 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d9955-2e93-47e3-8861-4ab8062a0bf0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.489858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.490554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.490840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.491107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.491893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:29.492203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.493615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.504715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 296/604] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:29.505696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.547372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fffe4-3c73-498d-9258-ea927415ceee None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.581184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.582373 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.582855 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.583132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.593941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:29.601034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:29.602278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 309/605] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:29.607862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.610966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b5f5c-ebea-4f57-820e-a8b022eee682 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.645385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.646303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.646636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.646855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/6c290be79dec4fe8b10bc04e691c00b1/roles/da56ace2cb7e42d29ebc9789d9f3c756` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.662103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=6c290be79dec4fe8b10bc04e691c00b1, role_id=da56ace2cb7e42d29ebc9789d9f3c756)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.663555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.686134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 297/606] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:29 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/6c290be79dec4fe8b10bc04e691c00b1/roles/da56ace2cb7e42d29ebc9789d9f3c756 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:29.686134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.726021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcd8ac-67c2-481f-9481-d3edad2c990f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.771056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.772246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.772597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.772939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.783532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.785634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.791548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a161c-a3cf-4520-8ae2-deed230b3cfd None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.801394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:29.803186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 310/607] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:29.803994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.837342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.838305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.838588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.838967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/9c6a3dbc0cbe4acc81a8691fc85c7352/roles/da56ace2cb7e42d29ebc9789d9f3c756` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.855982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=9c6a3dbc0cbe4acc81a8691fc85c7352, role_id=da56ace2cb7e42d29ebc9789d9f3c756)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.857444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.879823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 298/608] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:29 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/9c6a3dbc0cbe4acc81a8691fc85c7352/roles/da56ace2cb7e42d29ebc9789d9f3c756 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:29.880650 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.909271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551475-05fb-4529-850e-131924cbcf12 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:29.947589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:29.948275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:29.948553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:29.948824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:29.949579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:29.949885 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:29.951344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:29.961147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 311/609] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:29.970148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:29.998287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1f20-bfa8-4669-87f0-a7369f943a75 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:30.035580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:30.036296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.036580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.036856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.037709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:30.038020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:30.039489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:30.056153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 299/610] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:30.058712 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:30.075701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10df89-02af-4434-896c-caa06f290d19 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:30.110012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:30.110916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.111198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.111472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.123360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:30.124834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:30.141506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:30.143121 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 312/611] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:30.149465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:30.161467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5fb80-8984-4c72-9cd4-4e2244a4e681 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:30.195745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:30.196645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.196924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.197199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/750a6a7b35204c47ac16a584e7e71713/roles/da56ace2cb7e42d29ebc9789d9f3c756` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.213461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=750a6a7b35204c47ac16a584e7e71713, role_id=da56ace2cb7e42d29ebc9789d9f3c756)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:30.214999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:30.238314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 300/612] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:30 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/750a6a7b35204c47ac16a584e7e71713/roles/da56ace2cb7e42d29ebc9789d9f3c756 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:30.253107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420b187-7f6a-456b-be6e-96559d753e6c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:30.290003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:30.290722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.291002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.291279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.292067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:30.292375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:30.293815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:30.308037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 313/613] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:30.313557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:30.453318 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a3e1-93b2-4d3c-9dee-f6f499e676c2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:30.488033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:30.488888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.489166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.489483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.496935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:30.498398 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:30.512311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 24 14:40:30.513893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 301/614] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:30.519094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:30.622542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c198-5aa9-4380-9864-efa7be0ca4a5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:30.664633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:30.665385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.665673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.665949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.666870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:30.667176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:30.668666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:30.693339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 314/615] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Mar 24 14:40:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:30.698372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:30.821075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc1074-1c6d-4ebd-b21f-baba6efec6cb None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:30.861478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b281c9a-2d67-41c8-99a4-21af08ff4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:30.862299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281c9a-2d67-41c8-99a4-21af08ff4cfa None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.862584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281c9a-2d67-41c8-99a4-21af08ff4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.862862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b281c9a-2d67-41c8-99a4-21af08ff4cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.873264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b281c9a-2d67-41c8-99a4-21af08ff4cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:30.874742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b281c9a-2d67-41c8-99a4-21af08ff4cfa None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:30.898745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-8b281c9a-2d67-41c8-99a4-21af08ff4cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:30.900136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 302/616] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:30.907394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:30.943660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459bf95-5eae-45c9-b3b6-5ff4091d025a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.943969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459bf95-5eae-45c9-b3b6-5ff4091d025a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.944200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459bf95-5eae-45c9-b3b6-5ff4091d025a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.946120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 303/617] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:30.953842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36869-6acf-430c-b2a8-d4a066ddfc4d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:30.954164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36869-6acf-430c-b2a8-d4a066ddfc4d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:30.954442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36869-6acf-430c-b2a8-d4a066ddfc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:30.979720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d8f36869-6acf-430c-b2a8-d4a066ddfc4d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:30.980920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d8f36869-6acf-430c-b2a8-d4a066ddfc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:31.087924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 304/618] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:31.096497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5dca-8968-40bd-afe3-cd910c7b4962 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:31.118225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36869-6acf-430c-b2a8-d4a066ddfc4d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.156187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:31.156888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:31.157125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:31.157395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:31.158258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:31.158563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:31.160258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:31.176028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 315/619] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:31.188644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.300340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36869-6acf-430c-b2a8-d4a066ddfc4d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:31.335182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e47638-eefe-4482-8bdd-e4349a7e3cd6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:31.338386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:31.339413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:31.339892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:31.340388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:31.350879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:31.358178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:31.359901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 305/620] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:31.367140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.379337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:31.380475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:31.380963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:31.381443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:31.395621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:31.398211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:31.420943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:31.424208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 316/621] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:31.429502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.499270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013d29b-426c-40ba-b4e6-9eee27eb5adf None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:31.536266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:31.537311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:31.537839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:31.538352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:31.539375 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:31.539892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:31.541509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:31.551357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 306/622] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:31.556592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.670227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ca641-54d7-41f4-ac17-44577cf09000 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:31.692411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b589-9f38-4d27-836f-ef70942a2770 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:31.708132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:31.709553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:31.710043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:31.710549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:31.721927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:31.724240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:31.742398 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:31.744461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 307/623] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:31.749547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.771666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:31.772337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:31.772617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:31.772886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:31.773672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:31.773979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:31.775462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:31.801451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 317/624] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:31.806781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.858793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2371801-3188-4168-a6b2-472c7962a137 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:31.895703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:31.896731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:31.897219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:31.897702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:31.898661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:31.899630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:31.901271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:31.914803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 308/625] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:31.919978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:31.984610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b810ef-7d8a-45a6-9c0f-5ba884a0cbc9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:32.020601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:32.021555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.021843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.022152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/58d77195060b4aeb8a9bfcef2dd147fd/roles/da56ace2cb7e42d29ebc9789d9f3c756` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.040288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=58d77195060b4aeb8a9bfcef2dd147fd, role_id=da56ace2cb7e42d29ebc9789d9f3c756)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:32.041922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:32.064011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 318/626] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:31 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/58d77195060b4aeb8a9bfcef2dd147fd/roles/da56ace2cb7e42d29ebc9789d9f3c756 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:40:32.134407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e42c43-cda8-4d62-b977-575d8c26b066 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:32.183432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:32.184251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.184534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.184809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.196529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:32.198060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:32.213532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:40:32.215151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 309/627] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:32.220935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:32.345715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d545-e6bf-4a1e-9555-eddcc339f87b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:32.379408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f986543-e84c-460e-8b0c-847e5b47370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:32.380083 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986543-e84c-460e-8b0c-847e5b47370e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.380362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986543-e84c-460e-8b0c-847e5b47370e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.380631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986543-e84c-460e-8b0c-847e5b47370e None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.381460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986543-e84c-460e-8b0c-847e5b47370e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:32.381761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986543-e84c-460e-8b0c-847e5b47370e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:32.383261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986543-e84c-460e-8b0c-847e5b47370e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:32.403151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 319/628] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:40:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:32.408702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:32.440151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371954ad-3651-4fb0-91a1-472941284ab7 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.440502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371954ad-3651-4fb0-91a1-472941284ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.440703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371954ad-3651-4fb0-91a1-472941284ab7 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.443023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 320/629] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:32.449154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3146-3efb-4f96-8781-592fbda7b5a0 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.449672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3146-3efb-4f96-8781-592fbda7b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.450292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3146-3efb-4f96-8781-592fbda7b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.481035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-deeb3146-3efb-4f96-8781-592fbda7b5a0 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:32.482255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-deeb3146-3efb-4f96-8781-592fbda7b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:32.592720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a54b3-e162-4daa-bb20-2f418df8c29a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:32.599688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 321/630] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:32.629420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:32.630150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.630437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.630713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.647619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3146-3efb-4f96-8781-592fbda7b5a0 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:32.701782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:32.706122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:32.802016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 310/631] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:32.807403 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:32.896249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3146-3efb-4f96-8781-592fbda7b5a0 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:32.917416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fc2d8-1621-4087-9570-6ee56825de24 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:32.941209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:32.942013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.942325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.942595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.962996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:32.969909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:32.971173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 322/632] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:32.987696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692382b-12ab-4278-b61d-891d3f09ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:32.988493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692382b-12ab-4278-b61d-891d3f09ce5a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:32.988766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692382b-12ab-4278-b61d-891d3f09ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:32.989034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692382b-12ab-4278-b61d-891d3f09ce5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:32.991710 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.010237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692382b-12ab-4278-b61d-891d3f09ce5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.012051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692382b-12ab-4278-b61d-891d3f09ce5a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.029088 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-a692382b-12ab-4278-b61d-891d3f09ce5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:33.030936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 311/633] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:33.032452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267b127-5537-4e74-a4bf-d2f535229635 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.032974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267b127-5537-4e74-a4bf-d2f535229635 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.033449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267b127-5537-4e74-a4bf-d2f535229635 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.039679 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 312/634] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:33.040738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267b127-5537-4e74-a4bf-d2f535229635 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.105135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec464-db35-4dbc-ab64-48fb5611a1cc None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.137769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8c15-7db5-4831-b274-24892188ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.138521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8c15-7db5-4831-b274-24892188ebda None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.138761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8c15-7db5-4831-b274-24892188ebda None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.139038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8c15-7db5-4831-b274-24892188ebda None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.139779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d8c15-7db5-4831-b274-24892188ebda None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:33.140083 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d8c15-7db5-4831-b274-24892188ebda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.141456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d8c15-7db5-4831-b274-24892188ebda None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.149801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 323/635] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:33.150861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667ab8-16ff-4051-84c3-e3b038337469 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.151148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667ab8-16ff-4051-84c3-e3b038337469 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.151424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667ab8-16ff-4051-84c3-e3b038337469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.154812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267b127-5537-4e74-a4bf-d2f535229635 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.167681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-bc667ab8-16ff-4051-84c3-e3b038337469 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:33.168896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bc667ab8-16ff-4051-84c3-e3b038337469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:33.187893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbd034-b1c0-4f4e-9cab-e106911b5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.188555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbd034-b1c0-4f4e-9cab-e106911b5b2a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.188863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbd034-b1c0-4f4e-9cab-e106911b5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.189134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbd034-b1c0-4f4e-9cab-e106911b5b2a None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.189908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbd034-b1c0-4f4e-9cab-e106911b5b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:33.190248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbd034-b1c0-4f4e-9cab-e106911b5b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.191663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbd034-b1c0-4f4e-9cab-e106911b5b2a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.207725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 313/636] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:33.207725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0029a-f4c8-4035-82c3-211f0cb0bba0 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.207725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0029a-f4c8-4035-82c3-211f0cb0bba0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.207725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0029a-f4c8-4035-82c3-211f0cb0bba0 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.208686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 314/637] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:33.209339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0029a-f4c8-4035-82c3-211f0cb0bba0 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.243977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 324/638] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:33.244763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667ab8-16ff-4051-84c3-e3b038337469 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.315277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0029a-f4c8-4035-82c3-211f0cb0bba0 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.347692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667ab8-16ff-4051-84c3-e3b038337469 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.349617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0fbb1-554b-46ac-95fe-67588800662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.350959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fbb1-554b-46ac-95fe-67588800662d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.351239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fbb1-554b-46ac-95fe-67588800662d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.351507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0fbb1-554b-46ac-95fe-67588800662d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.362378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0fbb1-554b-46ac-95fe-67588800662d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.363800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0fbb1-554b-46ac-95fe-67588800662d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.379664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.379848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-95a0fbb1-554b-46ac-95fe-67588800662d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:33.380462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.380744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.385773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.385890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 315/639] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:33.385890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49d112-47eb-4283-8628-f53e13bb98f3 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.385890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49d112-47eb-4283-8628-f53e13bb98f3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.385890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49d112-47eb-4283-8628-f53e13bb98f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.392645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.394076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.402492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-9a49d112-47eb-4283-8628-f53e13bb98f3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:33.403662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-9a49d112-47eb-4283-8628-f53e13bb98f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:33.406942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:33.412911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 325/640] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:33.412911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.478625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 316/641] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:33.479498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49d112-47eb-4283-8628-f53e13bb98f3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.526493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefafce-031e-4566-9481-8f2267d658ff None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.566328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.567163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.567455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.567734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.572132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49d112-47eb-4283-8628-f53e13bb98f3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.577778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:33.585001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:33.586518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 326/642] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:33.587167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.606147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.606808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.607090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.607362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.608082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:33.608393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.609750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.620347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 317/643] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:33.621114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.688727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c208cdf-27ba-4caa-a343-d1b92af9a1c3 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.717730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87504d4-42c6-4b1c-8f74-223f016737cd None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.721404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.722066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.722372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.722643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.723420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:33.723727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.725149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.741532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 327/644] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:33.741532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.754641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.755515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.755795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.756063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.767251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:33.774361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:33.780336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 318/645] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:33.780336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.837227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619150-56fd-4e13-b701-31c5c56977ec None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.874968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.875878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.876410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.876835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.877062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340cef-675f-43a0-9782-89ed257f2c1f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:33.877896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:33.878378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.879898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.892457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 328/646] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:33.893349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.913750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:33.914842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:33.915327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:33.915769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:33.923451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:33.924887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:33.937806 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 24 14:40:33.943736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 319/647] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:33.943736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:33.991697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52a804-36cf-4416-923b-370c69290a0b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.024751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.025406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.025679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.025958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.026813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=1cc15d4ea22b441ab70b958fba26a07f) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:34.027125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.028554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.034379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 329/648] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/role_assignments?user.id=1cc15d4ea22b441ab70b958fba26a07f&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:34.035148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.040985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3861f-4e29-415a-902c-a75e6244e0a0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.078505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.079970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.080488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.080955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.081930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:34.082464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.084113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.093917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 320/649] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:34.095223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.141869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de430f0-857d-4ac0-b5e9-5db546c053d1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.177137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.177952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.178267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.178537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.190458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.191942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.205069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1570a-09f0-4155-81e2-008c65edaeeb None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.209596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:34.215258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 330/650] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:34.215258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.250695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.250898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.251130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.251420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.252272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:34.252582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.254022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.277163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 321/651] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:34.278592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.346439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df54bc0-d7be-4d7c-bf86-ed0af37bcf5e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.386154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.387470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.388233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.388956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.396047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5b566-38f8-404a-82a1-e1c193ed649c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.402225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.404371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.422976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:34.424558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 331/652] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:34.425427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.431168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.432094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.432586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.433061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.433973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:34.434493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.436064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.448031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 322/653] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:34.453195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.527222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e7de-7a7a-480f-937d-06204d932dab None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.560579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.561232 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.561514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.561791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.562208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb476-8b21-4311-85c8-be723241214e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.595898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.596907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.597384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.597875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.598809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:34.599306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.600870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.613169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 323/654] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:34.614409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.629361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.630924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.708384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed390-a51d-44de-84e3-1016daa9971b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.726743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 332/655] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:34.727829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.745303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46723c7-fe93-4f3d-993c-5a582a0b7960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.746103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46723c7-fe93-4f3d-993c-5a582a0b7960 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.746421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46723c7-fe93-4f3d-993c-5a582a0b7960 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.746694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46723c7-fe93-4f3d-993c-5a582a0b7960 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.753671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46723c7-fe93-4f3d-993c-5a582a0b7960 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.755157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46723c7-fe93-4f3d-993c-5a582a0b7960 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.768497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e46723c7-fe93-4f3d-993c-5a582a0b7960 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 24 14:40:34.769816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 324/656] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:34.770851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538da879-9fdc-43fc-af2b-0e46cf9ed9b9 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.771135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538da879-9fdc-43fc-af2b-0e46cf9ed9b9 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.771410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538da879-9fdc-43fc-af2b-0e46cf9ed9b9 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.776932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 325/657] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:34.776932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538da879-9fdc-43fc-af2b-0e46cf9ed9b9 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.831687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e421ba-cfcc-49ba-9201-619e65a2a954 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.867352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.868205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.868481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.868780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.875934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538da879-9fdc-43fc-af2b-0e46cf9ed9b9 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:34.876058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.877502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.890772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 24 14:40:34.892254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 333/658] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:34.892857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:34.915572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b572d-aca9-4851-87fc-ba19d2d1da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:34.916384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b572d-aca9-4851-87fc-ba19d2d1da59 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.916634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b572d-aca9-4851-87fc-ba19d2d1da59 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.916905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b572d-aca9-4851-87fc-ba19d2d1da59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.926632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b572d-aca9-4851-87fc-ba19d2d1da59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:34.928062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b572d-aca9-4851-87fc-ba19d2d1da59 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:34.945581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-8b5b572d-aca9-4851-87fc-ba19d2d1da59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:34.951390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 326/659] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:34.951390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852269-f245-4139-8998-e0c52873e020 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:34.951390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852269-f245-4139-8998-e0c52873e020 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:34.951390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852269-f245-4139-8998-e0c52873e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:34.966874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ac852269-f245-4139-8998-e0c52873e020 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:34.968043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ac852269-f245-4139-8998-e0c52873e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:34.989522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d9b2a-53c3-47b2-99fa-7353352ea561 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.024454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.025475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.025962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.026431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.027343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:35.027652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.029081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.038283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 327/660] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:35.038283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac852269-f245-4139-8998-e0c52873e020 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.049352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 334/661] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Mar 24 14:40:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:35.050216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.138524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac852269-f245-4139-8998-e0c52873e020 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.146074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cb50e-4a2a-49e2-aaa3-9a2cf81059ca None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.172033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.172694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.172970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.173268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.174118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:35.174448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.175851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.181442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.182104 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.182411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.182667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.183373 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:35.183670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.185014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.195146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 328/662] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:35.196152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.196318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 335/663] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:35.197133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.294688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd78a6-f8e1-4b48-8b2c-91b5226afbb2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.297482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43d48-efbe-4ba2-ade6-17a3c9429a08 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.325997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.326812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.327089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.327357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.331024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.331815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.332229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.332631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.337331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:35.344072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:35.345277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 336/664] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:35.346033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.402927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.404298 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.444567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277237-155f-4683-a5dd-b862d137d4b0 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.477422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.478241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.478519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.478786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.485290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.486812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.500001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 329/665] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:35.500139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:35.501145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.506116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 337/666] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:35.506965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.595935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7bdb5-5dd0-4593-92a0-4fcb262907ee None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.598652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1cb5-e0ac-46ad-9aca-915827b69ed6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.628894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d381f-1089-476a-853e-946625404571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.629529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d381f-1089-476a-853e-946625404571 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.629827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d381f-1089-476a-853e-946625404571 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.630066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d381f-1089-476a-853e-946625404571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.630957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.631622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.631902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.632171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.632908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:35.633213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.634620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.642728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 338/667] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:35.643625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.698545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d381f-1089-476a-853e-946625404571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.699912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d381f-1089-476a-853e-946625404571 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.737412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e478-08e6-49a9-86db-22d53dedd343 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.768691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.769482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.769761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.770030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.780081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.781512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.795154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 330/668] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:35.795991 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d381f-1089-476a-853e-946625404571 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.802046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:35.807554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 339/669] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:35.807554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.897833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d381f-1089-476a-853e-946625404571 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.904520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37850-b147-4029-ab07-bf1e0ec1df92 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:35.932695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.933352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.933634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.933908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.934735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:35.935043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.936481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.939874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:35.940665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:35.940944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:35.941213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:35.947731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 331/670] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:35.948537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:35.953468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:35.955352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:35.976310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:35.982817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 340/671] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:35.983067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.043645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269bf8-3b0b-46df-a3da-d434907c9640 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.077530 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.078379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.078665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.078943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.080159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ac4cf-d311-4b73-a804-c67bcf847257 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.091854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.093583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.111002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:36.112231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 332/672] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:36.113019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.119523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.120205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.120482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.120754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.121462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:36.121767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.123201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.135445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 341/673] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:36.136627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.222549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28cee3-acb3-44d2-83a1-31bdd4171a78 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.233998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82d906-ba15-4d8a-86b8-d6059293f1fe None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.256604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.257528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.257982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.258451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.259446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=6c290be79dec4fe8b10bc04e691c00b1) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:36.260038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.261485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.267442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.278358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 333/674] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/role_assignments?user.id=6c290be79dec4fe8b10bc04e691c00b1&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:36.278567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.278567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.278567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.278813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.278892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:36.278892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.278892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.283514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 342/675] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:36.284500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.389398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35656bcf-2775-414d-a9bf-713f77bc9cfa None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.408309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f1cac-09be-48d6-b32e-692e17829a3b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.424724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.425552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.425832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.426130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.434108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.435328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.444966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96721c8-384d-4713-88f4-f2ca82be643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.445638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96721c8-384d-4713-88f4-f2ca82be643b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.445916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96721c8-384d-4713-88f4-f2ca82be643b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.446214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96721c8-384d-4713-88f4-f2ca82be643b None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.446943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96721c8-384d-4713-88f4-f2ca82be643b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:36.447244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96721c8-384d-4713-88f4-f2ca82be643b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.448618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96721c8-384d-4713-88f4-f2ca82be643b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.450013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:36.451650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 343/676] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:36.452533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.464579 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 334/677] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:36.466313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e21f2-47f3-44ca-a72e-b6cd0dea711c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.466661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e21f2-47f3-44ca-a72e-b6cd0dea711c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.467023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e21f2-47f3-44ca-a72e-b6cd0dea711c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.468941 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 335/678] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:36.470904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e21f2-47f3-44ca-a72e-b6cd0dea711c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.564424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e9050-eb66-4537-b38a-4d3662ec1b41 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.579227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e21f2-47f3-44ca-a72e-b6cd0dea711c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.596374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.597169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.597446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.597715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.604595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.606021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.614720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba61ff-57f7-4a67-b619-e53499d906d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.615974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba61ff-57f7-4a67-b619-e53499d906d8 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.616264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba61ff-57f7-4a67-b619-e53499d906d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.616541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba61ff-57f7-4a67-b619-e53499d906d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.617337 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba61ff-57f7-4a67-b619-e53499d906d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:36.617640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba61ff-57f7-4a67-b619-e53499d906d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.619079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba61ff-57f7-4a67-b619-e53499d906d8 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.619682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 24 14:40:36.625989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 344/679] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:36.625989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.639658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 336/680] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:36.639658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f051f-2e9c-41bf-8172-8502c29b8a17 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.639658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f051f-2e9c-41bf-8172-8502c29b8a17 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.639658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f051f-2e9c-41bf-8172-8502c29b8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.653079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7a7f051f-2e9c-41bf-8172-8502c29b8a17 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:36.654261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7a7f051f-2e9c-41bf-8172-8502c29b8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:36.720911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 337/681] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:36.722159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f051f-2e9c-41bf-8172-8502c29b8a17 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.737387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45f09d-013c-4603-8dcc-66ce49b5d832 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.777560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.778933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.779532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.780288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.788779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.791137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.807425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:36.809197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 345/682] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:36.810517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.819588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f051f-2e9c-41bf-8172-8502c29b8a17 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.852875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.853789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.854257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.854668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.855637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:36.856084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.857667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.874762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 338/683] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:36.875883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.920899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd20bc3-5e8b-4604-a9e3-a8dfb57cddf4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:36.951974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:36.952617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:36.952895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:36.953183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:36.953974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=9c6a3dbc0cbe4acc81a8691fc85c7352) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:36.954301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:36.956098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:36.961773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 346/684] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/role_assignments?user.id=9c6a3dbc0cbe4acc81a8691fc85c7352&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:36.962577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:36.986666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7289a-e57e-41e6-a121-68cf8110ed19 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.022277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.023085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.023352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.023671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.035341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:37.042510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:37.044085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 339/685] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:37.044951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.070018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6bc72-64b5-4b33-97f6-bde9bfda4bc5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.105567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.106266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.106546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.106815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.107603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:37.107907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.109423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.122254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 347/686] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:37.123120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.159980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04826dd6-f5e4-48fd-bba4-66a6fadaea38 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.197194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.197844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.198221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.198497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.232200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e53dd-887e-432d-b06c-0d4aea3bc407 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.265686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.266636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.267054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.267257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.267504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.268371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:37.268676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.269037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.270029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.278589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 348/687] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:37.279480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.395231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 340/688] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:37.396424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.404895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f68c3-642c-4edb-9b7c-414cc3eeaaac None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.446138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.447172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.447457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.447734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.448588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=750a6a7b35204c47ac16a584e7e71713) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:37.448901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.450418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.462246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 349/689] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/role_assignments?user.id=750a6a7b35204c47ac16a584e7e71713&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:37.462246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.568340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4fcf3-aaa5-4620-afd2-723c6192b042 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.582479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3f956-e9e5-4618-8b7c-9bb161f6aedd None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.603615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.604569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.604943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.605307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.616054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.617973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.625963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.627546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.628067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.628479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.635301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:37.636994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 341/690] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:37.640549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.642312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.642458 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.661706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:37.663775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 350/691] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:37.669414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.786874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45aee-751f-445d-8512-0f8d47c6d3af None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.826675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.827933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.828340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.828732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.830047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:37.830588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.832548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.848161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e320-59a3-40b4-ae1d-5eb163c248d9 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:37.848994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 351/692] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:37.855531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:37.890609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:37.893044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:37.893350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:37.893629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:37.894399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:37.894705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:37.897350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:37.913555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 342/693] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:37.919674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:38.009279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418f34-20da-40da-a460-3b5305ea3c76 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:38.047576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:38.048418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.048697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.048987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.056974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:38.058559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:38.074066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:38.075926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 352/694] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:38.078793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe81b2-537c-49bf-b58f-960a89fc34cc None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:38.081702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:38.155926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:38.156727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.157005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.157283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.179611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:38.180994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:38.209768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:40:38.212723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 343/695] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:40:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:38.218033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:38.257970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f05905-f711-4530-8361-1b40305ab8fe None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:38.353575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:38.354557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.354999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.355457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.356397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:38.357155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:38.358794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:38.386537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 353/696] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:38.395328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:38.492724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063a0f-9167-4ef6-ad6a-576677639907 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:38.543350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:38.544276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.544691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.545110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.546137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:38.546615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:38.548362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:38.567005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051eaf-feb8-4ce9-a37e-7dc9f87ce9b6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:38.583737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 344/697] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:40:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:38.590920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:38.610477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa101f2c-d467-466b-b3ba-b93611899223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:38.610477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101f2c-d467-466b-b3ba-b93611899223 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.610477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101f2c-d467-466b-b3ba-b93611899223 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.610477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa101f2c-d467-466b-b3ba-b93611899223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.610947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa101f2c-d467-466b-b3ba-b93611899223 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=58d77195060b4aeb8a9bfcef2dd147fd) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:38.610947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa101f2c-d467-466b-b3ba-b93611899223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:38.611288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa101f2c-d467-466b-b3ba-b93611899223 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:38.618129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 354/698] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:38 2022] GET /identity/v3/role_assignments?user.id=58d77195060b4aeb8a9bfcef2dd147fd&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:38.721440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565d415-f874-43fc-89e3-ecb96f29ce1a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:38.769947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:38.770553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.770836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.771112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.851863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:38.853342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:38.881688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95f78-b54c-467e-87b8-9498ae78e8ec None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.882347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95f78-b54c-467e-87b8-9498ae78e8ec None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.882821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95f78-b54c-467e-87b8-9498ae78e8ec None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.885159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 355/699] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:38.891001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fc015-e414-4a21-8e75-b3473ee26629 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:38.891573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fc015-e414-4a21-8e75-b3473ee26629 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:38.892087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fc015-e414-4a21-8e75-b3473ee26629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:38.929606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-4d0fc015-e414-4a21-8e75-b3473ee26629 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:38.930903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4d0fc015-e414-4a21-8e75-b3473ee26629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:38.968413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 345/700] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:38.974970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.003744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 356/701] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:39.029076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fc015-e414-4a21-8e75-b3473ee26629 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.086063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568abf3f-ba15-47dc-b249-195abd96ed83 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.125558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.126423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.126705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.126981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.137065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.138609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.140438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fc015-e414-4a21-8e75-b3473ee26629 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.157934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:39.159661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 346/702] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:39.165413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.179183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.180453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.180929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.181387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.182264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.183826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.199860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 24 14:40:39.201443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 357/703] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Mar 24 14:40:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:39.207728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.271035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772550b-996b-4e7a-99f1-7529f4e52931 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.306157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295959-c8e7-4eff-80d7-f71b35579c12 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.307981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.308841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.309316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.309774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.310857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:39.311350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.312897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.325003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 347/704] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:39.330868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.339951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.340630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.340915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.341195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.341909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:39.342249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.343643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.348586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 358/705] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Mar 24 14:40:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:39.354666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.440816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78872d4b-7e87-44e3-849a-dd63a6e47d6b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.455000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee42fa3-57ec-4ae4-afd5-b6f7dbf18185 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.489260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.489931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.490247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.490521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.491235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:39.491546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.492918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.493087 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.493846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.494148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.494424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.498950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 359/706] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Mar 24 14:40:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:39.508049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.509541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.539865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:39.541482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 348/707] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:39.547231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.697966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae9c5-ade1-40f0-ac62-e8321d0f3112 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.742659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d3694-208d-43df-8d07-7c1ce4e29372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.743320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3694-208d-43df-8d07-7c1ce4e29372 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.743597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3694-208d-43df-8d07-7c1ce4e29372 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.743867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3694-208d-43df-8d07-7c1ce4e29372 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.744654 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d3694-208d-43df-8d07-7c1ce4e29372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:39.744959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d3694-208d-43df-8d07-7c1ce4e29372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.746414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d3694-208d-43df-8d07-7c1ce4e29372 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.763954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 360/708] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:39.769750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:39.870143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d3dd-7cab-4483-b192-dd679f9e271c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:39.896465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9842c-4d74-4744-b02e-dab236f45b31 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.896783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9842c-4d74-4744-b02e-dab236f45b31 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.897020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9842c-4d74-4744-b02e-dab236f45b31 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.905241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 361/709] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:39.905241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22233-6c5b-4a3f-b45c-4f7b08d795a2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.905435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:39.905547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22233-6c5b-4a3f-b45c-4f7b08d795a2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.905547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c22233-6c5b-4a3f-b45c-4f7b08d795a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.905667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:39.905667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:39.905778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:39.906956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=1cc15d4ea22b441ab70b958fba26a07f) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:39.907064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:39.908690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:39.915755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 349/710] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:39 2022] GET /identity/v3/role_assignments?user.id=1cc15d4ea22b441ab70b958fba26a07f&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:39.930538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-32c22233-6c5b-4a3f-b45c-4f7b08d795a2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:39.931773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-32c22233-6c5b-4a3f-b45c-4f7b08d795a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:40.013684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 362/711] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:40.067901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:40.185513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38839-19f4-41af-99a2-967da38a1e18 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:40.219368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:40.220224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:40.220499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:40.220765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:40.230834 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:40.232328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:40.256435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:40.257945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 350/712] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:40.263557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c22233-6c5b-4a3f-b45c-4f7b08d795a2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:40.376389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c22233-6c5b-4a3f-b45c-4f7b08d795a2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:40.422411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bf47b-af54-4a28-acd8-22142a393f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:40.423112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf47b-af54-4a28-acd8-22142a393f09 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:40.423392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf47b-af54-4a28-acd8-22142a393f09 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:40.423662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bf47b-af54-4a28-acd8-22142a393f09 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:40.424375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bf47b-af54-4a28-acd8-22142a393f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:40.424673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bf47b-af54-4a28-acd8-22142a393f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:40.426108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bf47b-af54-4a28-acd8-22142a393f09 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:40.437724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 363/713] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:40.443005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:40.565840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b4ebb-9a7c-40d0-b7e3-20cd1aab776f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:40.572676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444f172-397c-41f9-bb34-cb15673c6625 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:40.573140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444f172-397c-41f9-bb34-cb15673c6625 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:40.573552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444f172-397c-41f9-bb34-cb15673c6625 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:40.575469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 364/714] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:40.582110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a231-cb48-432c-b2f1-e84c605bc8a3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:40.582110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a231-cb48-432c-b2f1-e84c605bc8a3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:40.582110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a231-cb48-432c-b2f1-e84c605bc8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:40.611108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3804a231-cb48-432c-b2f1-e84c605bc8a3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:40.613158 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3804a231-cb48-432c-b2f1-e84c605bc8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:40.631692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:40.632599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:40.633016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:40.633425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:40.634308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:40.635863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:40.667481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 351/715] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:40:40 2022] POST /identity/v3/users => generated 254 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:40.708445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 365/716] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:40.743209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:40.865329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e76fd1-61de-4d98-b67a-2ae5e626aa99 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:40.906103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:40.906103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:40.906103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:40.906103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] PATH_INFO: `/v3/services/network` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:40.906441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:40.907276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:40.920021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 24 14:40:40.921559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 352/717] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:40 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:40.927238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804a231-cb48-432c-b2f1-e84c605bc8a3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:41.030425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804a231-cb48-432c-b2f1-e84c605bc8a3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:41.063958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4936d5c-149c-4c99-8ac8-16385b15c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:41.064624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936d5c-149c-4c99-8ac8-16385b15c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:41.064901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936d5c-149c-4c99-8ac8-16385b15c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:41.065173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936d5c-149c-4c99-8ac8-16385b15c5b5 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:41.065865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936d5c-149c-4c99-8ac8-16385b15c5b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:41.066187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936d5c-149c-4c99-8ac8-16385b15c5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:41.067561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936d5c-149c-4c99-8ac8-16385b15c5b5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:41.072330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 366/718] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:40:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:41.077968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:41.188737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a345bb-1c39-4b86-9309-ba087d612d72 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:41.233167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd490-c0e5-4e59-a808-d58ae40609c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:41.233830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd490-c0e5-4e59-a808-d58ae40609c9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:41.234132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd490-c0e5-4e59-a808-d58ae40609c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:41.234413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd490-c0e5-4e59-a808-d58ae40609c9 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:41.235131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd490-c0e5-4e59-a808-d58ae40609c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:41.235463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd490-c0e5-4e59-a808-d58ae40609c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:41.236869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd490-c0e5-4e59-a808-d58ae40609c9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:41.246853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 353/719] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:40:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:41.738732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55834e4a-1c7b-4add-8cdc-aa605ff40936 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:41.739250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55834e4a-1c7b-4add-8cdc-aa605ff40936 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:41.739250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55834e4a-1c7b-4add-8cdc-aa605ff40936 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:41.741056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 367/720] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:41.746929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180d86e-f98a-4c7a-a7f9-84069d15887c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:41.747223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180d86e-f98a-4c7a-a7f9-84069d15887c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:41.747503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180d86e-f98a-4c7a-a7f9-84069d15887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:41.767167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6180d86e-f98a-4c7a-a7f9-84069d15887c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:41.768387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6180d86e-f98a-4c7a-a7f9-84069d15887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:41.868868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 354/721] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:41.904166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55834e4a-1c7b-4add-8cdc-aa605ff40936 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:42.022725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55834e4a-1c7b-4add-8cdc-aa605ff40936 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:42.055022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:42.055823 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.056102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.056375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.066262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:42.073013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:42.074528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 368/722] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:42.080350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180d86e-f98a-4c7a-a7f9-84069d15887c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:42.230647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180d86e-f98a-4c7a-a7f9-84069d15887c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:42.274294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcded4-c8cd-4930-ab1b-30ad99f5a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:42.275356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcded4-c8cd-4930-ab1b-30ad99f5a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.275885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcded4-c8cd-4930-ab1b-30ad99f5a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.276346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcded4-c8cd-4930-ab1b-30ad99f5a4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.277287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcded4-c8cd-4930-ab1b-30ad99f5a4b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:42.277793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcded4-c8cd-4930-ab1b-30ad99f5a4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:42.279448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcded4-c8cd-4930-ab1b-30ad99f5a4b1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:42.293021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 355/723] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:42.298707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:42.371444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd5fb-1503-4356-887b-414a7f7b0c4a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.372072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd5fb-1503-4356-887b-414a7f7b0c4a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.372561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd5fb-1503-4356-887b-414a7f7b0c4a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.378884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 356/724] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:42.383725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99752f-a824-4857-9c2e-3a3863cb7eca None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.384258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99752f-a824-4857-9c2e-3a3863cb7eca None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.384727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99752f-a824-4857-9c2e-3a3863cb7eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.410728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32216c-4224-4377-b211-48f77830a154 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:42.415090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7d99752f-a824-4857-9c2e-3a3863cb7eca None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:42.416280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7d99752f-a824-4857-9c2e-3a3863cb7eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:42.450464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:42.451271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.451551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.451820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.475332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:42.476785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:42.505719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:42.507279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 369/725] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:42.515266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:42.531724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 357/726] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:42.553972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99752f-a824-4857-9c2e-3a3863cb7eca None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:42.650415 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f6741-ef1e-4b5a-8d23-7541b99e0547 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:42.651314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99752f-a824-4857-9c2e-3a3863cb7eca None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:42.684804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:42.685478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.685761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.686113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.686972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:42.688693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:42.695273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:42.695998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.696283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.696557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.697725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:42.697725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:42.699234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:42.708580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 358/727] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:40:42 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:40:42.721148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 370/728] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:42.727515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:42.887345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae399d-031b-4d20-b83e-780fd5e6fcfe None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:42.939954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:42.945956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:42.946311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:42.946597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:42.955026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:42.956484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:42.975126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 24 14:40:42.976774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 359/729] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:42.982756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.099390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe576-af10-4507-8809-b6c53ea0be5d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:43.132874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ed853-628e-4b05-9b54-adc60bbe70a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:43.133557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed853-628e-4b05-9b54-adc60bbe70a1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.133841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed853-628e-4b05-9b54-adc60bbe70a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.134134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ed853-628e-4b05-9b54-adc60bbe70a1 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.134982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ed853-628e-4b05-9b54-adc60bbe70a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:43.135292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ed853-628e-4b05-9b54-adc60bbe70a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:43.136746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ed853-628e-4b05-9b54-adc60bbe70a1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:43.154973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 371/730] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Mar 24 14:40:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:43.160387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.273242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36ebea-e40b-403b-9b42-dd8202f79840 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.273581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36ebea-e40b-403b-9b42-dd8202f79840 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.275849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36ebea-e40b-403b-9b42-dd8202f79840 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.275957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbf81b-b467-469a-aa8c-4db4e57a645a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:43.276036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 372/731] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:43.281002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842500f-fe23-4e80-baa5-3b412350be77 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.281293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842500f-fe23-4e80-baa5-3b412350be77 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.281570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842500f-fe23-4e80-baa5-3b412350be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.298345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2842500f-fe23-4e80-baa5-3b412350be77 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:43.299621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2842500f-fe23-4e80-baa5-3b412350be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:43.311047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:43.312026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.312524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.312995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.368463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 373/732] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 24 14:40:43.380470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:43.382255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:43.392144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842500f-fe23-4e80-baa5-3b412350be77 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.487477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 360/733] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:43 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 24 14:40:43.499122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.506141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842500f-fe23-4e80-baa5-3b412350be77 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:43.546407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:43.546407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.546407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.546407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.551923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:43.559028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:43.560568 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 374/734] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:43.566287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.666535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56170f9d-6beb-4a19-9ce0-ef3de9a673cb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:43.671959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16ccc5-aba8-4872-af1e-4cd483672a7f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:43.699542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231fbc2-9eb4-424c-9d48-92ac9f1c0042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:43.700265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231fbc2-9eb4-424c-9d48-92ac9f1c0042 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.700551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231fbc2-9eb4-424c-9d48-92ac9f1c0042 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.700875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231fbc2-9eb4-424c-9d48-92ac9f1c0042 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.701673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231fbc2-9eb4-424c-9d48-92ac9f1c0042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:43.701933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231fbc2-9eb4-424c-9d48-92ac9f1c0042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:43.703430 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231fbc2-9eb4-424c-9d48-92ac9f1c0042 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:43.707273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a7b8-d673-4ca2-8b4d-44a519af5cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:43.708293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a7b8-d673-4ca2-8b4d-44a519af5cc3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.708789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a7b8-d673-4ca2-8b4d-44a519af5cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.709251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a7b8-d673-4ca2-8b4d-44a519af5cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.713162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 375/735] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:43.719101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f23f-c02c-4b6b-80d2-1725baeb0d2d None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.719399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f23f-c02c-4b6b-80d2-1725baeb0d2d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.719679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f23f-c02c-4b6b-80d2-1725baeb0d2d None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.721431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 376/736] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:43.725470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174f23f-c02c-4b6b-80d2-1725baeb0d2d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.725873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936a7b8-d673-4ca2-8b4d-44a519af5cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:43.727613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936a7b8-d673-4ca2-8b4d-44a519af5cc3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:43.745348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-1936a7b8-d673-4ca2-8b4d-44a519af5cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:43.747198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 361/737] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:43.748657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f16e6d-f275-43e7-b1d5-995db154211d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.749178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f16e6d-f275-43e7-b1d5-995db154211d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.749646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f16e6d-f275-43e7-b1d5-995db154211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.766369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b2f16e6d-f275-43e7-b1d5-995db154211d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:43.767891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b2f16e6d-f275-43e7-b1d5-995db154211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:43.825378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174f23f-c02c-4b6b-80d2-1725baeb0d2d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:43.842228 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 362/738] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:43.843592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f16e6d-f275-43e7-b1d5-995db154211d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.872052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:43.872862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:43.873146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:43.873425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:43.885643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:43.887243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:43.909332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:43.910990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 377/739] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:43.911829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:43.970257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f16e6d-f275-43e7-b1d5-995db154211d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.010547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.011278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.011854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.012138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.013125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:44.013428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.015529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.019957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d0a1f-417b-44bf-b8ab-8307ff9aac0a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.029300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 363/740] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:44.030410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.054308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.055286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.055575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.055853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.066053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:44.073126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:44.074700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 378/741] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:44.075483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.142343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a721-e0f9-48b3-b24b-66df65d81cce None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.178244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.178906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.179185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.179456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.180076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4cc16-ccae-4236-b67b-68fbea93ea4f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.180184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:44.180468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.181839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.194884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 364/742] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:44.195846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.218398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.219204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.219493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.219802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.226544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.228057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.241571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:44.247444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 379/743] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:44.247444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.299500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e3424-f6e1-4f70-8826-5aad8a2d371a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.333071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832aab5-b21b-4abc-beac-c9dd228df513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.333986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832aab5-b21b-4abc-beac-c9dd228df513 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.334302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832aab5-b21b-4abc-beac-c9dd228df513 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.334578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832aab5-b21b-4abc-beac-c9dd228df513 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.335332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832aab5-b21b-4abc-beac-c9dd228df513 None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:44.335640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832aab5-b21b-4abc-beac-c9dd228df513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.337011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832aab5-b21b-4abc-beac-c9dd228df513 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.342109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a29c-7038-4aed-a3fd-a6343f8f1762 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.349331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 365/744] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:44.349331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3638e-d0c1-49bf-8ee0-b0e825ad663c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.349331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3638e-d0c1-49bf-8ee0-b0e825ad663c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.349331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3638e-d0c1-49bf-8ee0-b0e825ad663c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.352271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 366/745] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:44.352944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3638e-d0c1-49bf-8ee0-b0e825ad663c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.376252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.377134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.377443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.377715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.384682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.386172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.399391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:40:44.400573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 380/746] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:44.404675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.450505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3638e-d0c1-49bf-8ee0-b0e825ad663c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.485118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5264d52-1683-4811-a3a2-afbdea0ded06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.485812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264d52-1683-4811-a3a2-afbdea0ded06 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.486111 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264d52-1683-4811-a3a2-afbdea0ded06 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.486386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5264d52-1683-4811-a3a2-afbdea0ded06 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.487171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5264d52-1683-4811-a3a2-afbdea0ded06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:44.487474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5264d52-1683-4811-a3a2-afbdea0ded06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.488942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5264d52-1683-4811-a3a2-afbdea0ded06 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.497785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce65bb-4ed8-4e85-98b3-77e3e7894a5f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.500200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 367/747] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:44.501388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64560a-569f-4d51-9aed-6a932e6e7dc7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.501670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64560a-569f-4d51-9aed-6a932e6e7dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.501939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64560a-569f-4d51-9aed-6a932e6e7dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.517414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-8f64560a-569f-4d51-9aed-6a932e6e7dc7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:44.518615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8f64560a-569f-4d51-9aed-6a932e6e7dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:44.534673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.535475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.535769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.536035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.545672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.547148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.563993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:44.565624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 381/748] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:44.566541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.594113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 368/749] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 24 14:40:44.594113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64560a-569f-4d51-9aed-6a932e6e7dc7 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.676508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c674c8-8d25-4bdf-85f8-9829ba21d32b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.692690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64560a-569f-4d51-9aed-6a932e6e7dc7 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.709111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.709783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.710067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.710368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.711201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:44.711505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.712948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.727208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.727864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.728145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.728422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.729257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=58d77195060b4aeb8a9bfcef2dd147fd) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:44.734023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.734164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 382/750] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:44.734164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.734324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.746546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 369/751] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/role_assignments?user.id=58d77195060b4aeb8a9bfcef2dd147fd&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:44.747548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.853064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7283c0-6083-42bc-b6a8-a8c85ae5067d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.868796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef25c10-418b-44f5-b255-4f82cd141a08 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:44.888530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.889206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.889484 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.889752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.890542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:44.890844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.892294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.904816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 383/752] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:44.905851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:44.908868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:44.910731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:44.911212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:44.911732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:44.912687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:44.914439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:44.932088 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 370/753] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:40:44 2022] POST /identity/v3/services => generated 240 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:44.933305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.031129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06b8c-fd26-4d13-8d21-fc4326f3d165 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.060481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34084017-4408-4a4d-ac9d-ff45f7207a1a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.068208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.069387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.069868 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.070395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.082516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.084320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.095715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.096626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.096955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.097232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.102874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:45.104757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 384/754] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:45.105859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.114143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.115461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.122515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 24 14:40:45.124190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 371/755] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:40:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:45.129510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.244967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe20963-d383-4a15-92de-bec7fa64993d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.261590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422fdfc-597f-4321-8f75-1a64479b085d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.284713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.285391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.285670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.285940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.286817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:45.287117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.288545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.297261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.298263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.298719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.299167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.300149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:45.300624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.302174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.307060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 372/756] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:45.315169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.318982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 385/757] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:45.324678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.464901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cb247-a533-4945-a4a4-5e8cf98459dc None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.501267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21db07-1f05-495b-b14e-4d2c2ceb0d85 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.511341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e52b7-eb97-4080-9eab-56be135a6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.512008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e52b7-eb97-4080-9eab-56be135a6372 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.512286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e52b7-eb97-4080-9eab-56be135a6372 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.512557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e52b7-eb97-4080-9eab-56be135a6372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.573858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8bb9f-0523-48bb-97fd-0b6a6b76d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.574690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8bb9f-0523-48bb-97fd-0b6a6b76d245 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.574972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8bb9f-0523-48bb-97fd-0b6a6b76d245 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.575242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8bb9f-0523-48bb-97fd-0b6a6b76d245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.583932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8bb9f-0523-48bb-97fd-0b6a6b76d245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.585540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8bb9f-0523-48bb-97fd-0b6a6b76d245 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.602240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-48d8bb9f-0523-48bb-97fd-0b6a6b76d245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:45.603717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 386/758] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:45.609934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45cf65-fa88-45e0-8c4f-616155634559 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.610247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45cf65-fa88-45e0-8c4f-616155634559 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.610558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45cf65-fa88-45e0-8c4f-616155634559 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.611900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e52b7-eb97-4080-9eab-56be135a6372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.616445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 387/759] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:45.616445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45cf65-fa88-45e0-8c4f-616155634559 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.616644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e52b7-eb97-4080-9eab-56be135a6372 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.716633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 373/760] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:40:45.718340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f6b1-4a2c-401f-969f-63ec0879afd8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.718852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f6b1-4a2c-401f-969f-63ec0879afd8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.719432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43f6b1-4a2c-401f-969f-63ec0879afd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.722215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45cf65-fa88-45e0-8c4f-616155634559 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.738052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-5c43f6b1-4a2c-401f-969f-63ec0879afd8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:45.739278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5c43f6b1-4a2c-401f-969f-63ec0879afd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:45.756732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.757395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.757673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.757943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.758752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:45.759052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.760471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.777196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 388/761] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:45.778092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.806041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 374/762] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:45.806919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43f6b1-4a2c-401f-969f-63ec0879afd8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.877206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fc44e-61da-48bb-8ba2-88436ad9efd6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.903176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43f6b1-4a2c-401f-969f-63ec0879afd8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:45.916832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.917899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.918356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.918770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.929420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.931111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.937253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:45.938183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:45.938501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:45.939121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/1cc15d4ea22b441ab70b958fba26a07f/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:45.940919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=1cc15d4ea22b441ab70b958fba26a07f, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:45.942258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:45.949993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:45.951329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 389/763] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:45.952105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:45.959762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 375/764] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:45 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/1cc15d4ea22b441ab70b958fba26a07f/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:45.960874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.059218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310eb05-3927-4fcd-af97-0eca50a5264d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.068402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34d68-94f3-4a19-87bd-b0dfe18d9123 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.096628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.097469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.097755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.098033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.098739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.100143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.108677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.109731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.110231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.110740 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.111665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:46.112174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.113406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 24 14:40:46.114037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.115034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 390/765] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:46.127483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.127815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 376/766] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:46.133461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.229578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c999b-ebe7-4721-8240-5a6cad4126e7 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.250402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a368992-39f7-4caf-956f-9848ec896eaa None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.270230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.270923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.271205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.271478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.272211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:46.273925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.275261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.287189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 391/767] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Mar 24 14:40:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:46.289402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.316215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.317036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.317447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.317726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.332542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.333986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.352214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:46.353777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 377/768] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:46.360526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.411090 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad242d48-4f2b-4638-8022-b8b394fc2452 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.444721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.445686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.446213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.446708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.447592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:46.448073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.449630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.455650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 392/769] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Mar 24 14:40:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:46.461817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.477161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49c53-d0b8-4083-a2a6-d89e5b29f8a2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.523731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.524401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.524681 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.524957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.525750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:46.526061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.527514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.549897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 378/770] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:46.556613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.627695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b45ba-f385-4d1a-ab1b-211bd3be4d85 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.693942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.695086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.695613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.696102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.697088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] RBAC: Adding query filter params (interface=public, service_id=2fe5df7d85564584a9e76988c53c9271, region_id=RegionOne) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:46.697620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.699215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.711442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264d8f-3683-43ba-9805-772cce92a5f6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.711943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 393/771] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:40:46 2022] GET /identity/v3/endpoints?service_id=2fe5df7d85564584a9e76988c53c9271&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:46.718273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:46.752635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956a2b-f0bc-44b1-afe1-3ff98bb6d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.753292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956a2b-f0bc-44b1-afe1-3ff98bb6d864 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.753574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956a2b-f0bc-44b1-afe1-3ff98bb6d864 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.753847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956a2b-f0bc-44b1-afe1-3ff98bb6d864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.754714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956a2b-f0bc-44b1-afe1-3ff98bb6d864 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ac6e1bff8c1f44c38b86d3ebda419784) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:46.758618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956a2b-f0bc-44b1-afe1-3ff98bb6d864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.760113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956a2b-f0bc-44b1-afe1-3ff98bb6d864 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.776155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 379/772] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:46 2022] GET /identity/v3/role_assignments?user.id=ac6e1bff8c1f44c38b86d3ebda419784&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:46.840360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371a31b-78d1-4789-ba4e-12c291925a62 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:46.875420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d757f-8fc0-406e-8d10-7f246a363eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:46.876171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d757f-8fc0-406e-8d10-7f246a363eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:46.876455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d757f-8fc0-406e-8d10-7f246a363eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:46.876736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d757f-8fc0-406e-8d10-7f246a363eb5 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:46.877427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d757f-8fc0-406e-8d10-7f246a363eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:46.878886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d757f-8fc0-406e-8d10-7f246a363eb5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:46.890247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 394/773] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:40:46 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:47.349865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c1f2-4225-44ae-b18d-7165398c0411 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:47.350415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c1f2-4225-44ae-b18d-7165398c0411 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:47.350513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c1f2-4225-44ae-b18d-7165398c0411 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:47.352438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 380/774] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:47.370215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724539e-87a2-4d4b-b59b-555e04821987 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:47.370723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724539e-87a2-4d4b-b59b-555e04821987 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:47.370808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724539e-87a2-4d4b-b59b-555e04821987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:47.392095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1724539e-87a2-4d4b-b59b-555e04821987 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:47.393299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1724539e-87a2-4d4b-b59b-555e04821987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:47.476035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 395/775] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:47.509997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c1f2-4225-44ae-b18d-7165398c0411 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:47.653024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c1f2-4225-44ae-b18d-7165398c0411 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:47.660913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab99b6-03a2-4064-9537-85dd3431a8f7 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:47.661243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab99b6-03a2-4064-9537-85dd3431a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:47.661479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab99b6-03a2-4064-9537-85dd3431a8f7 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:47.663681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 396/776] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:47.674686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7ded-5273-410c-a06a-2b09591a95da None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:47.674972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7ded-5273-410c-a06a-2b09591a95da None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:47.675235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7ded-5273-410c-a06a-2b09591a95da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:47.691413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:47.692210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:47.692493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:47.692768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:47.705822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-447c7ded-5273-410c-a06a-2b09591a95da None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:47.707025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-447c7ded-5273-410c-a06a-2b09591a95da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:47.712020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:47.718922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:47.720489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 381/777] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:47.730992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:47.822321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 397/778] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:47.872959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c7ded-5273-410c-a06a-2b09591a95da None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:47.889774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97f50-0dff-454b-8f40-75ad91218f27 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:47.931642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:47.932312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:47.932753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:47.933039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:47.933789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:47.934105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:47.935503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:47.944954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 382/779] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:47.951092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.040683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c7ded-5273-410c-a06a-2b09591a95da None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.084282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.085099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.085385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.085659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] PATH_INFO: `/v3/services/network` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.086348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.087733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.108757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 24 14:40:48.109981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 398/780] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:47 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:48.125575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.154100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab31569-c45c-407f-959d-d00a2f34c914 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.211415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.212231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.212517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.212791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.232606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.234063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.256491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed60d7-abd5-46a2-b29f-b8765cf3b58d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.261385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:48.262970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 383/781] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:48.268275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.297222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.298344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.298824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.299321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.300222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] RBAC: Adding query filter params (name=network) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:48.300719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.302345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.312836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 399/782] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:40:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:48.323058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.450139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae72af8-f316-4bdc-8bb5-3a5ef039ecdc None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.494264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddff66-7f80-49e5-8ac6-beac2293a051 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.507998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.508674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.508950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.509221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.509944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:48.510269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.511624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.531151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 384/783] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:48.536672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.551535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.552256 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.552534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.552844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.553547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] RBAC: Adding query filter params (type=network) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:48.553851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.555464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.562802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 400/784] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:40:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:48.569629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.705976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be0c4-9e67-4a2f-bb38-2f326480c7ef None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.745863 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.746555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.746839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.747116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.747906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] RBAC: Adding query filter params (interface=public, service_id=5efa5bc001bb47a0942a0b931992f5e0, region_id=RegionOne) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:48.748216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.749588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.753817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c5334-67f3-4c12-b9e5-f8dd84bf24c1 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.766885 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 401/785] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:40:48 2022] GET /identity/v3/endpoints?service_id=5efa5bc001bb47a0942a0b931992f5e0&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:48.772138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.814814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.815636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.815917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.816195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.831286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.832744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.857622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 24 14:40:48.866606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 385/786] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:48.872182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:48.905650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f7b4a-22f4-493b-893b-7b98b1de42bc None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.980614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15f415-f7c9-40d8-87cf-07bf5346d1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:48.983119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f415-f7c9-40d8-87cf-07bf5346d1ba None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.983307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f415-f7c9-40d8-87cf-07bf5346d1ba None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.983557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15f415-f7c9-40d8-87cf-07bf5346d1ba None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:48.984245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15f415-f7c9-40d8-87cf-07bf5346d1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:48.985670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15f415-f7c9-40d8-87cf-07bf5346d1ba None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:48.991186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 402/787] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:40:48 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:48.998682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae2b84-2f04-4e47-881c-307dae98013a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:48.998865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7ef8-6ca8-4c46-a9c2-ba645b96a5e3 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:48.999088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7ef8-6ca8-4c46-a9c2-ba645b96a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:48.999264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7ef8-6ca8-4c46-a9c2-ba645b96a5e3 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.005388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 403/788] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:49.007117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fced149-ed05-473c-be6d-c40737842cbe None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.007377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fced149-ed05-473c-be6d-c40737842cbe None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.007653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fced149-ed05-473c-be6d-c40737842cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.037273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3fced149-ed05-473c-be6d-c40737842cbe None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:49.038551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3fced149-ed05-473c-be6d-c40737842cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:49.045564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.046644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.047121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.047585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.048710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:49.049210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:49.051354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:49.073534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 386/789] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Mar 24 14:40:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:49.082606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.182073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 404/790] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:40:49.232053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fced149-ed05-473c-be6d-c40737842cbe None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.248735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a499a20-c72a-4153-abef-aa7b436e065a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:49.285523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.286334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.286613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.286884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.298172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:49.299638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:49.317966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:49.319612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 387/791] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:49.325074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.343622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fced149-ed05-473c-be6d-c40737842cbe None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:49.379023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.380096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.380571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.381016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.392028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:49.399187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:49.400892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 405/792] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:49.406483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.472218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ce35c-d32a-488a-9b5d-d7a49d2a2ea9 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:49.515886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faa141-66a7-4e1f-88ea-3072c95a3b90 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:49.553881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.555389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.556286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.556766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.557596 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.558045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.559012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:49.559473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.559914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.560392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:49.561282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:49.562864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:49.563401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:49.564941 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:49.582544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 406/793] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:49.583729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 388/794] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:49.588380 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.589399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.692040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dabbb-a8d2-428b-ba72-9932700b979f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:49.724438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354dc1d-fe17-42e2-9a86-a40d3bfcf8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.725239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354dc1d-fe17-42e2-9a86-a40d3bfcf8bf None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.725521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354dc1d-fe17-42e2-9a86-a40d3bfcf8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.725822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354dc1d-fe17-42e2-9a86-a40d3bfcf8bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.733169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354dc1d-fe17-42e2-9a86-a40d3bfcf8bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:49.734714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354dc1d-fe17-42e2-9a86-a40d3bfcf8bf None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:49.747219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67936990-f0f4-4950-a9b4-60ea8362437a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:49.749294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-b354dc1d-fe17-42e2-9a86-a40d3bfcf8bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:49.750656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 389/795] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:49.751814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb9c7a-24a5-4f06-889f-db30d389eed5 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.752133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb9c7a-24a5-4f06-889f-db30d389eed5 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.752440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb9c7a-24a5-4f06-889f-db30d389eed5 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.754374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 390/796] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:49.755558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1faf80-fbf1-4d2c-8646-a535d7c34c26 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.755933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1faf80-fbf1-4d2c-8646-a535d7c34c26 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.756229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1faf80-fbf1-4d2c-8646-a535d7c34c26 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.758033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 391/797] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:49.762131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33985d-f835-4249-ba8e-afe1b3f25d7b None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.762595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33985d-f835-4249-ba8e-afe1b3f25d7b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.762945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33985d-f835-4249-ba8e-afe1b3f25d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.779647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-8e33985d-f835-4249-ba8e-afe1b3f25d7b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:49.780887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8e33985d-f835-4249-ba8e-afe1b3f25d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:49.782544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.783341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.783623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.783898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.794005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:49.795486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:49.811398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:49.817084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 407/798] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:49.817084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.848720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 392/799] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:40:49.850271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4475b-7215-42fa-be66-d0094c5d0c97 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.850725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4475b-7215-42fa-be66-d0094c5d0c97 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.851175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4475b-7215-42fa-be66-d0094c5d0c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.869628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-33c4475b-7215-42fa-be66-d0094c5d0c97 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:49.871093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-33c4475b-7215-42fa-be66-d0094c5d0c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:49.936234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e02b7-bbd7-4f2d-ac20-0d5212e74e03 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:49.946104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 393/800] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:49.946104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4475b-7215-42fa-be66-d0094c5d0c97 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:49.977525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:49.978228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:49.978507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:49.978776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:49.979749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:49.980095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:49.981621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:49.994314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 408/801] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:49.995149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.040398 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4475b-7215-42fa-be66-d0094c5d0c97 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.073765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.074474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.074787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.075092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.075852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:50.076190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.077584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.089552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 394/802] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:50.090430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.097665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f6bbe-8f3e-4faa-8f99-eb67cb9db2ff None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.133112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.134168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.134620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.134884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.135538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.136900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.148006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 24 14:40:50.154245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 409/803] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Mar 24 14:40:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:50.154245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.194408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67015a5e-9ae4-49fb-8388-cb41206984f0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.229232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.230465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.230783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.231364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.242311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:50.249181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:50.249983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0712f-7c08-4317-82f2-406772059685 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.250485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 395/804] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:50.251303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.287184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.288072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.288354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.288627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/58d77195060b4aeb8a9bfcef2dd147fd/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.290676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=58d77195060b4aeb8a9bfcef2dd147fd, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.292067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.314388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 410/805] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:50 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/58d77195060b4aeb8a9bfcef2dd147fd/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:40:50.314388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.367949 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576645-fefc-48c7-a843-7cb0fcbea4f7 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.409096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.410332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.410716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.411223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.422615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.424206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.435883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f79b2-811b-4bba-9e4d-9a59fa49b45e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.439829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:40:50.441287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 396/806] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:50.446880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.478362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.479969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.480467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.481119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.482595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:50.483192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.484808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.495782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 411/807] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:50.496932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.565946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c28e-d9af-4651-8eae-ea299d2f1b67 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.605708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.606445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.606766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.607079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.608032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:50.608377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.610440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.612001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5f8dc-7e18-4457-88fc-6dd45b9ca35d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.620193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 397/808] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:50.621458 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.649993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.650668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.650952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.651224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.652052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:50.652370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.653794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.672803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 412/809] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:50.674013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.733985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b18f3-013b-4677-bfff-b6e8bbe5da58 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.767875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.768585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.768952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.769268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.770026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:50.770397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.771853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.777147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 398/810] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:50.778020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.787077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9843aba-da73-49b2-9f3c-5708eab79f0c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.828857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.830330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.830880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.831396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.844980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:50.847502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:50.867457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:50.869771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 413/811] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:50.871299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:50.890962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d390b-2a7c-4c51-9d3c-1cf70e744aa2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:50.930978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:50.931989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:50.932373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:50.932759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:50.977030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5362a-3ccd-47ff-b9da-42c8fe4d30e5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.011171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.012179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.012627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.013117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.014044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.015529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.015836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.017061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.040593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 414/812] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:40:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:51.041837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.132455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 399/813] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:40:51.137649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.197828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef6504-1727-4e8b-aa59-6d5f9a4c3215 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.275332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.276025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.276308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.276582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.277314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:51.277619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.279049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.294283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 415/814] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:51.299989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.332280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16314c8e-3214-4297-b657-a6e498e2c2db None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.374763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.375559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.375883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.376163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.390805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.393300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.414448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:51.416554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 400/815] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:51.422936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.432958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fce90-c708-4a92-9dcb-220461a88f9c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.470032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.470953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.471233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.471501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.481054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.482634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.498013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 24 14:40:51.500398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 416/816] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:51.507007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.540717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395bcb9-bc35-4d04-bd8c-fbf075de5cf6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.574794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1c660-9e73-455c-8b11-ee4a6b5efa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.575737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1c660-9e73-455c-8b11-ee4a6b5efa62 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.576017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1c660-9e73-455c-8b11-ee4a6b5efa62 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.576290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1c660-9e73-455c-8b11-ee4a6b5efa62 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.578063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1c660-9e73-455c-8b11-ee4a6b5efa62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:51.578411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1c660-9e73-455c-8b11-ee4a6b5efa62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.580179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1c660-9e73-455c-8b11-ee4a6b5efa62 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.595644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 401/817] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:51.597345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e543a-09ea-4db7-b09e-02b7051c5b6a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.597630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e543a-09ea-4db7-b09e-02b7051c5b6a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.598062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e543a-09ea-4db7-b09e-02b7051c5b6a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.600713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 402/818] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:51.602361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e543a-09ea-4db7-b09e-02b7051c5b6a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.616332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cd8e1-165a-4b25-89f5-c89b92c24fbd None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.654307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3381b13-6ae8-4b97-b695-79311b768b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.655035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3381b13-6ae8-4b97-b695-79311b768b41 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.655318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3381b13-6ae8-4b97-b695-79311b768b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.655588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3381b13-6ae8-4b97-b695-79311b768b41 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.656481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3381b13-6ae8-4b97-b695-79311b768b41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:51.656787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3381b13-6ae8-4b97-b695-79311b768b41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.658399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3381b13-6ae8-4b97-b695-79311b768b41 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.676562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 417/819] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:51.677913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e6502-14a6-4730-bf5c-658b50d999d6 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.678297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e6502-14a6-4730-bf5c-658b50d999d6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.678576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e6502-14a6-4730-bf5c-658b50d999d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.694736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c91e6502-14a6-4730-bf5c-658b50d999d6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:51.695959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c91e6502-14a6-4730-bf5c-658b50d999d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:51.710869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e543a-09ea-4db7-b09e-02b7051c5b6a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.750186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.751307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.751834 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.752109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.760195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.760913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 418/820] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:51.761618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.761851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e6502-14a6-4730-bf5c-658b50d999d6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.787824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:51.789145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 403/821] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:51.789784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.873090 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e6502-14a6-4730-bf5c-658b50d999d6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.906364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.907301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.907675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.908043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.916967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c24-98f5-4938-800b-a6d291115a3d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:51.918340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.920324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.936634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:51.938355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 419/822] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:51.939214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:51.955275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:51.956074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:51.956351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:51.956619 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] PATH_INFO: `/v3/services/network` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:51.957276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:51.958678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:51.972131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 24 14:40:51.978027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 404/823] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:51.978027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.050042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2782-8b23-40b6-a55b-fbac75f62e5e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.084174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.084598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.084878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.085149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.085946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:52.086269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.087717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.094889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e60d2-cdf2-4891-bad7-de5650e61c55 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.103872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 420/824] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:52.103872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.140775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.141467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.141749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.142021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.142791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:52.143092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.144478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.156448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 405/825] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:52.157153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.210272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f9c7f-c020-48da-87d4-7ee6a72c2a9c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.250219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.251497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.251949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.252390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.253029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c788774-ddc3-46d9-a4a6-a14840c7a243 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.253470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] RBAC: Adding query filter params (name=network) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:52.253939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.256506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.266938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 421/826] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:40:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:52.267123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.290845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.291504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.291780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.292048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.292868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=1cc15d4ea22b441ab70b958fba26a07f) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:52.293170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.294638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.306645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 406/827] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:52 2022] GET /identity/v3/role_assignments?user.id=1cc15d4ea22b441ab70b958fba26a07f&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:52.306645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.384972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e77ec-bc6c-4860-a423-b6eb4bc6e874 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.422554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.423324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.423602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.423872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.438175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.439796 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.465737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:52.467419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 422/828] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:52.471831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5003b-4464-42a4-a6e3-0a4b7f5c8bfe None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.473371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.507000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.507674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.507953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.508222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.508936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] RBAC: Adding query filter params (type=network) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:52.509235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.510649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.516614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 407/829] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:40:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:52.523437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.634807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4eabf-e76c-4b8c-a9b6-a6b27a885e9d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.661300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fe323-4f21-4080-96be-7ea3b5a06330 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.668248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.668922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.669200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.669474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.671133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:52.671446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.673000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.686425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 423/830] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:52.692013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:52.701691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc9bd7-c8d1-4347-aeb5-0c1d548e193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.702616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9bd7-c8d1-4347-aeb5-0c1d548e193d None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.703095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9bd7-c8d1-4347-aeb5-0c1d548e193d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.703581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9bd7-c8d1-4347-aeb5-0c1d548e193d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.704900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc9bd7-c8d1-4347-aeb5-0c1d548e193d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.706553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc9bd7-c8d1-4347-aeb5-0c1d548e193d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.732447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 408/831] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:40:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:52.796858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3b53-ba7a-42f1-ad8a-a96804897cf3 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.797138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3b53-ba7a-42f1-ad8a-a96804897cf3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.797412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3b53-ba7a-42f1-ad8a-a96804897cf3 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.799410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 409/832] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:52.803198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2e96-ed49-4457-b5b6-d5064348c954 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:52.808661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a85e-1dd6-4af5-8d59-79ded1d90d3b None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.809090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a85e-1dd6-4af5-8d59-79ded1d90d3b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.809486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894a85e-1dd6-4af5-8d59-79ded1d90d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.835578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e894a85e-1dd6-4af5-8d59-79ded1d90d3b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:52.837133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e894a85e-1dd6-4af5-8d59-79ded1d90d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:52.878824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:52.880391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:52.880973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:52.882833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/ac6e1bff8c1f44c38b86d3ebda419784/roles/da56ace2cb7e42d29ebc9789d9f3c756` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:52.911754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=ac6e1bff8c1f44c38b86d3ebda419784, role_id=da56ace2cb7e42d29ebc9789d9f3c756)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:52.915430 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:52.942996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 424/833] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:40:52 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/ac6e1bff8c1f44c38b86d3ebda419784/roles/da56ace2cb7e42d29ebc9789d9f3c756 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:40:52.972765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 410/834] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:52.999327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:53.116595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4415a-ebb0-4c42-8a14-bbf0fe3f5508 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:53.155914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:53.157183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.157602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.158017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.169244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:53.176422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:40:53.178177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 425/835] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:53.184172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a85e-1dd6-4af5-8d59-79ded1d90d3b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:53.290869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894a85e-1dd6-4af5-8d59-79ded1d90d3b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:53.323938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:53.324667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.324951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.325229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.326025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:53.326363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:53.327737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:53.337034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 411/836] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:53.343182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:53.444727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e992e12-2b22-4f24-bc04-3b5c5e7c69f7 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:53.478991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:53.479808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.480087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.480361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.492599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:53.494115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:53.511808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:53.513361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 426/837] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:53.518978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:53.615350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e557-5ffa-48ba-8985-da080ce806c1 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:53.648196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:53.648858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.649139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.649463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.650144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:53.650448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:53.651819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:53.663961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 412/838] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:53.669849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:53.766347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2cb70-fc7e-40ca-ac3c-0a818388c122 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:53.798624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb8c35-fc43-405e-8851-0a352a42344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:53.799791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb8c35-fc43-405e-8851-0a352a42344d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.800270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb8c35-fc43-405e-8851-0a352a42344d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.800725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb8c35-fc43-405e-8851-0a352a42344d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.808551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb8c35-fc43-405e-8851-0a352a42344d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:53.810245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb8c35-fc43-405e-8851-0a352a42344d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:53.824044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-9deb8c35-fc43-405e-8851-0a352a42344d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 24 14:40:53.826060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 427/839] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:40:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:53.832573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:53.882658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aa81d-2221-4948-af3a-fa9cdf66dfcb None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.883254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aa81d-2221-4948-af3a-fa9cdf66dfcb None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.883717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aa81d-2221-4948-af3a-fa9cdf66dfcb None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.885970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 428/840] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:53.891637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f819fe-9ca0-4306-a516-1b4bad758113 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.892431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f819fe-9ca0-4306-a516-1b4bad758113 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.892906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f819fe-9ca0-4306-a516-1b4bad758113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.912235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-65f819fe-9ca0-4306-a516-1b4bad758113 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:53.913413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-65f819fe-9ca0-4306-a516-1b4bad758113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:53.940557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97b40-0c18-4dfa-8338-20e1e7f9b216 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:53.975213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:53.976244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:53.976930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:53.977654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:53.979767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:53.980927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:53.986118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 429/841] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:53.987493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.005294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 413/842] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Mar 24 14:40:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:54.010620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.010739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f819fe-9ca0-4306-a516-1b4bad758113 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.115181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fdb9-d7cf-4376-b254-769a05c3781e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:54.134613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f819fe-9ca0-4306-a516-1b4bad758113 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:54.160406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:54.161091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:54.161368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:54.161636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:54.172928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:54.174215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:54.174740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:54.175218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:54.176098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:54.177656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.189063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 24 14:40:54.194437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 430/843] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:54.196813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.239916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:54.241704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.301932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b4c91-f9c9-418e-bef7-e2404693d0db None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:54.335008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:54.335616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:54.335893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:54.336165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:54.336883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:54.337179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:54.338565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.351685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 431/845] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:54.351685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.352059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 414/845] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:40:54.353105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.443999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eee4a1-38b2-4770-9994-73d7eb079696 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:54.446412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f600de-d1d9-4b5c-a5ac-b271108c0a62 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:54.478013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:54.478807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:54.479089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:54.479399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:54.480062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:54.480362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:54.481468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:54.481824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.482693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:54.483192 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:54.483645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:54.490786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 432/846] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:54.494855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:54.496634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.515735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:54.517730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 415/847] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:54.523589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.626474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b63a6d-1844-4148-a6af-acfacfe90f84 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:54.669359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:54.670060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:54.670623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:54.670623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:54.671375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:54.671681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:54.673159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.686954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 433/848] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:54.692509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.791351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff1a4c-be68-4542-9b51-9ca567a2aa96 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:54.828605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f4e4f-7d10-4563-b7ac-d578e7aed15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:54.829453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4e4f-7d10-4563-b7ac-d578e7aed15f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:54.830046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4e4f-7d10-4563-b7ac-d578e7aed15f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:54.830347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f4e4f-7d10-4563-b7ac-d578e7aed15f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:54.837116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f4e4f-7d10-4563-b7ac-d578e7aed15f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:54.838586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f4e4f-7d10-4563-b7ac-d578e7aed15f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:54.851390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-645f4e4f-7d10-4563-b7ac-d578e7aed15f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:54.852896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 416/849] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:54.858577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:54.964925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b545d-4f78-408e-b01a-571b003f52d9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:55.002434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:55.003103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.003384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.003657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.004443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:55.004749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:55.006216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:55.018751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 434/850] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:55.023764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6984f5-e481-4dfc-bbd8-e2dacd85ef0b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.024223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6984f5-e481-4dfc-bbd8-e2dacd85ef0b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.024651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6984f5-e481-4dfc-bbd8-e2dacd85ef0b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.027135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:55.027689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 417/851] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:55.033520 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f681-cffa-4321-beaf-0f246c59227f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.034232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f681-cffa-4321-beaf-0f246c59227f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.034752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f681-cffa-4321-beaf-0f246c59227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.053942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2916f681-cffa-4321-beaf-0f246c59227f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:55.055543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2916f681-cffa-4321-beaf-0f246c59227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:55.134423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 418/852] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:40:55.145329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14e7dd-79cd-45ec-8bb7-3be39b8cafc8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:55.147785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f681-cffa-4321-beaf-0f246c59227f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:55.189133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:55.190159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.190622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.191434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.192773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=58d77195060b4aeb8a9bfcef2dd147fd) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:55.193432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:55.195334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:55.203711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 435/853] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:55 2022] GET /identity/v3/role_assignments?user.id=58d77195060b4aeb8a9bfcef2dd147fd&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:55.254780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f681-cffa-4321-beaf-0f246c59227f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:55.292216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb237-45cd-4e75-b1bd-8c19a2b9848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:55.293389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb237-45cd-4e75-b1bd-8c19a2b9848c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.293853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb237-45cd-4e75-b1bd-8c19a2b9848c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.294345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb237-45cd-4e75-b1bd-8c19a2b9848c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.295224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb237-45cd-4e75-b1bd-8c19a2b9848c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:55.296839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb237-45cd-4e75-b1bd-8c19a2b9848c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:55.309678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-442fb237-45cd-4e75-b1bd-8c19a2b9848c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 24 14:40:55.311668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 419/854] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Mar 24 14:40:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:55.319275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:55.422231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8186-6bee-468d-b923-cb46eac04a5e None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.422549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8186-6bee-468d-b923-cb46eac04a5e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.422854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8186-6bee-468d-b923-cb46eac04a5e None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.424785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 420/855] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:55.429880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b46c-74ac-472d-a23e-2afb211a4773 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.430199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b46c-74ac-472d-a23e-2afb211a4773 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.430475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b46c-74ac-472d-a23e-2afb211a4773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.432456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a14c6-3f00-44ce-8a9b-7b1e4989081c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:55.449972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-1c34b46c-74ac-472d-a23e-2afb211a4773 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:55.451189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1c34b46c-74ac-472d-a23e-2afb211a4773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:55.478668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:55.479337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.479617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.479889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.480598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:55.480903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:55.482310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:55.487846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 436/856] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:40:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:55.492216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:55.530602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 421/857] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:55.555564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b46c-74ac-472d-a23e-2afb211a4773 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:55.608307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9e031-3cc5-430f-a96d-3ac7fce3181b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:55.641268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:55.642255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.642752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.643204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.644091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:55.644616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:55.646257 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:55.651350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 437/858] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:40:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:55.669798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b46c-74ac-472d-a23e-2afb211a4773 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:55.708969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:55.710701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.711179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.711644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.723198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:40:55.730986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:40:55.732988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 422/859] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:55.739371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:55.843234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faba46-79b9-46bd-9ede-f41b41a31a45 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:55.884483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:55.885141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:55.885412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:55.885690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:55.886469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:55.886771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:55.888191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:55.896616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 438/860] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:55.904974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:56.006842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53d92-53e3-4955-abbf-0ab677815068 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:56.040001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:56.040801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:56.041087 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:56.041365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:56.052266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:56.053727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:56.070590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:56.072168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 423/861] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:56.077365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:56.179109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c394c0-5706-4d74-8d66-b7fc5b61c5e0 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:56.211488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049809-3c21-464d-9748-88547117fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:56.212147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049809-3c21-464d-9748-88547117fb11 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:56.212424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049809-3c21-464d-9748-88547117fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:56.212745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049809-3c21-464d-9748-88547117fb11 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:56.213461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42049809-3c21-464d-9748-88547117fb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:56.213760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42049809-3c21-464d-9748-88547117fb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:56.215148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42049809-3c21-464d-9748-88547117fb11 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:56.227163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 439/862] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:56.232386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:56.329130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2f89-b52e-43f9-a349-3e563a745d2b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:56.362142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:56.362960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:56.363240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:56.363514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:56.375266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:56.376788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:56.392030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 24 14:40:56.393701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 424/863] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:40:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:56.399059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049809-3c21-464d-9748-88547117fb11 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:56.495427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049809-3c21-464d-9748-88547117fb11 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:56.530249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:56.530939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:56.531218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:56.531496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:56.532392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:56.532697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:56.534197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:56.553451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 440/864] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Mar 24 14:40:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:56.559041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:56.657171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1fa7f-c25a-402f-9988-7face77d8a73 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:56.689222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64f380-1715-49c8-bb3e-92af3d356add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:56.690206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64f380-1715-49c8-bb3e-92af3d356add None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:56.690662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64f380-1715-49c8-bb3e-92af3d356add None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:56.691106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64f380-1715-49c8-bb3e-92af3d356add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:56.761490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64f380-1715-49c8-bb3e-92af3d356add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:56.763702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64f380-1715-49c8-bb3e-92af3d356add None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:56.861259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 425/865] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:40:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:40:56.867369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:56.906016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3e5d-e9a0-48fa-9a8f-924bff363cfa None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:56.906437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3e5d-e9a0-48fa-9a8f-924bff363cfa None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:56.906813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a3e5d-e9a0-48fa-9a8f-924bff363cfa None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:56.909001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 426/866] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:40:56.913948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290c987-8514-4106-9774-707d81235973 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:56.914257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290c987-8514-4106-9774-707d81235973 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:56.914533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290c987-8514-4106-9774-707d81235973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:56.931746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a290c987-8514-4106-9774-707d81235973 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:56.932964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a290c987-8514-4106-9774-707d81235973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:56.980570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2592c3-e1e1-4c32-9d90-1dd555e682cb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:57.006155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 427/867] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:57.022828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:57.023909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.024360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.024817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.032182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290c987-8514-4106-9774-707d81235973 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:57.037025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:57.038778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:57.072737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:40:57.074581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 441/868] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:57.081801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:57.137932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290c987-8514-4106-9774-707d81235973 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:57.171065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:57.172040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.172496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.172991 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.173966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:57.175553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:57.178394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca6ca2-362a-4848-ac2b-920281e89c14 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:57.192704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 428/869] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:40:57 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:40:57.234397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:57.235550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.236077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.236521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.237581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:57.238065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:57.239723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:57.253297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 442/870] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:57.259055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:57.371039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a6e41-3c51-4d95-8591-0d181e8b57be None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:57.404929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae199a1-3d9d-47fc-b05d-e31a30b5b1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:57.406180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae199a1-3d9d-47fc-b05d-e31a30b5b1b3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.406633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae199a1-3d9d-47fc-b05d-e31a30b5b1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.407124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae199a1-3d9d-47fc-b05d-e31a30b5b1b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.414296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae199a1-3d9d-47fc-b05d-e31a30b5b1b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:57.415754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae199a1-3d9d-47fc-b05d-e31a30b5b1b3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:57.429335 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-9ae199a1-3d9d-47fc-b05d-e31a30b5b1b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:40:57.430877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 429/871] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:57.437412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:57.542605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0d535-a6e1-46b6-9aed-45a0fb7e3ce4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:57.572597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ca6f3-447a-427b-909b-68766e14bb6f None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.572875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ca6f3-447a-427b-909b-68766e14bb6f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.573153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ca6f3-447a-427b-909b-68766e14bb6f None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.575186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 430/872] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:57.576822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:57.577702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.578181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.578648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.579938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:57.580452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:57.580552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce48d1-70c0-476d-9a60-dc1947766d01 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.580884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce48d1-70c0-476d-9a60-dc1947766d01 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.581223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce48d1-70c0-476d-9a60-dc1947766d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.582627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:57.597194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 443/873] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:57.598437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f1ce48d1-70c0-476d-9a60-dc1947766d01 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:57.599799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f1ce48d1-70c0-476d-9a60-dc1947766d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:57.603979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:57.674181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 431/874] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:57.690451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce48d1-70c0-476d-9a60-dc1947766d01 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:57.717003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56479-5a93-4a71-864d-6584340e2e52 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:57.752777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:57.753854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.754409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.754890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.755939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ac6e1bff8c1f44c38b86d3ebda419784) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:57.756454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:57.758098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:57.764357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 444/875] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:40:57 2022] GET /identity/v3/role_assignments?user.id=ac6e1bff8c1f44c38b86d3ebda419784&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:40:57.810903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce48d1-70c0-476d-9a60-dc1947766d01 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:57.846595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:57.847831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:57.848306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:57.848769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:57.849649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:57.851269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:57.863560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 24 14:40:57.865507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 432/876] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:40:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:40:57.871838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:57.978874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388bf96-8a5f-4f2e-bac2-9fdc522a7b50 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:58.013413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd921d-1131-4a77-8176-c27dc6ac535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:58.014388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd921d-1131-4a77-8176-c27dc6ac535e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:58.014806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd921d-1131-4a77-8176-c27dc6ac535e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:58.015214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd921d-1131-4a77-8176-c27dc6ac535e None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:58.016055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd921d-1131-4a77-8176-c27dc6ac535e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:58.016584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd921d-1131-4a77-8176-c27dc6ac535e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:58.018203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd921d-1131-4a77-8176-c27dc6ac535e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:58.023141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 445/877] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:40:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:58.028320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:58.090156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61515-4fc9-4601-9d81-edc59d001a98 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:58.090783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61515-4fc9-4601-9d81-edc59d001a98 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:58.091293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61515-4fc9-4601-9d81-edc59d001a98 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:58.093541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 446/878] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:58.103125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782b5d9-bbaf-4cd8-9755-64d9bd56770b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:58.103414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782b5d9-bbaf-4cd8-9755-64d9bd56770b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:58.103700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782b5d9-bbaf-4cd8-9755-64d9bd56770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:58.121012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b782b5d9-bbaf-4cd8-9755-64d9bd56770b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:58.122250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b782b5d9-bbaf-4cd8-9755-64d9bd56770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:58.137948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534e78-6e60-44b1-8e99-a1d711e83216 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:58.181290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89846089-865d-46d7-8ebe-a70c470c704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:58.182843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846089-865d-46d7-8ebe-a70c470c704f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:58.183330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846089-865d-46d7-8ebe-a70c470c704f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:58.183969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846089-865d-46d7-8ebe-a70c470c704f None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:58.185453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846089-865d-46d7-8ebe-a70c470c704f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:40:58.185944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846089-865d-46d7-8ebe-a70c470c704f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:58.187489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846089-865d-46d7-8ebe-a70c470c704f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:58.192501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 433/880] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:40:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:40:58.192625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 447/880] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:58.212906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782b5d9-bbaf-4cd8-9755-64d9bd56770b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:58.321799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782b5d9-bbaf-4cd8-9755-64d9bd56770b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:58.358338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd960b19-9a5c-42ad-85ef-12aa6eb69a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:58.359021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960b19-9a5c-42ad-85ef-12aa6eb69a87 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:58.359301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960b19-9a5c-42ad-85ef-12aa6eb69a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:58.359571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd960b19-9a5c-42ad-85ef-12aa6eb69a87 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:58.360364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd960b19-9a5c-42ad-85ef-12aa6eb69a87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:58.362027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd960b19-9a5c-42ad-85ef-12aa6eb69a87 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:58.382179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 448/881] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:40:58 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:40:59.604979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261e56-ea56-4727-b69f-f14b1cb13b2c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:59.605501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261e56-ea56-4727-b69f-f14b1cb13b2c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:59.605573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261e56-ea56-4727-b69f-f14b1cb13b2c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:59.607592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 434/882] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:40:59.613127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49388a6e-b5a9-46d3-9119-77bc628ddae6 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:59.613534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49388a6e-b5a9-46d3-9119-77bc628ddae6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:59.613694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49388a6e-b5a9-46d3-9119-77bc628ddae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:59.630362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-49388a6e-b5a9-46d3-9119-77bc628ddae6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:40:59.631547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-49388a6e-b5a9-46d3-9119-77bc628ddae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:40:59.704326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 449/883] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:40:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:40:59.727356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d261e56-ea56-4727-b69f-f14b1cb13b2c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:59.829787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d261e56-ea56-4727-b69f-f14b1cb13b2c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:40:59.865465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:40:59.865465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:40:59.865465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:40:59.865465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:40:59.865840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:40:59.867231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:40:59.879482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 24 14:40:59.885830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 435/884] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:40:59.887352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49388a6e-b5a9-46d3-9119-77bc628ddae6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:40:59.987397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49388a6e-b5a9-46d3-9119-77bc628ddae6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.021792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.022543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.022828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.023106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.023857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:00.024169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:00.025547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:00.034193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 450/885] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:40:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:00.036367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.136925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3d31b-bc67-40ab-ae2e-76e265265f67 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.173862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcee3d-216c-41b9-a9c7-87bbcc2d583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.174581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcee3d-216c-41b9-a9c7-87bbcc2d583b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.174866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcee3d-216c-41b9-a9c7-87bbcc2d583b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.175143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcee3d-216c-41b9-a9c7-87bbcc2d583b None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.175867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcee3d-216c-41b9-a9c7-87bbcc2d583b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:00.176233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcee3d-216c-41b9-a9c7-87bbcc2d583b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:00.177682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcee3d-216c-41b9-a9c7-87bbcc2d583b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:00.187744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 436/886] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:00.189145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.226599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde13d8b-656f-4095-a03a-da874ebeda10 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.226921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde13d8b-656f-4095-a03a-da874ebeda10 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.227164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde13d8b-656f-4095-a03a-da874ebeda10 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.230223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 437/887] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:00.235374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b6d89-5aaa-4b48-bec4-82f226bd6951 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.235874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b6d89-5aaa-4b48-bec4-82f226bd6951 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.236325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b6d89-5aaa-4b48-bec4-82f226bd6951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.254139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2f9b6d89-5aaa-4b48-bec4-82f226bd6951 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:00.255787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2f9b6d89-5aaa-4b48-bec4-82f226bd6951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:00.292391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a809be-d535-4ec6-b9cb-b4b3892f04c6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.330356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.331350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.331761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.332164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.333081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] RBAC: Adding query filter params (interface=public, service_id=2e0cae02293f4130a41281b34c86264b, region_id=RegionOne) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:00.333519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:00.334248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 438/888] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:00.335104 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:00.340637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 451/889] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/endpoints?service_id=2e0cae02293f4130a41281b34c86264b&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:00.347616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b6d89-5aaa-4b48-bec4-82f226bd6951 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.352983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.470194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b6d89-5aaa-4b48-bec4-82f226bd6951 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.476943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acc6b8-3684-4393-9a17-62c8f2fbb7ae None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.504171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65c6a8-84fc-44c0-bbb0-05293f467336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.504836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c6a8-84fc-44c0-bbb0-05293f467336 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.505123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c6a8-84fc-44c0-bbb0-05293f467336 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.505401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c6a8-84fc-44c0-bbb0-05293f467336 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.506126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65c6a8-84fc-44c0-bbb0-05293f467336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:00.507491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65c6a8-84fc-44c0-bbb0-05293f467336 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:00.513405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 439/890] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:41:00.514550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a457-dd33-4949-aec1-fb042ef9ef4b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.515105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a457-dd33-4949-aec1-fb042ef9ef4b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.515628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a457-dd33-4949-aec1-fb042ef9ef4b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.517324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 440/891] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:00.522821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.523770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.524159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.524474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a9e49-7835-412c-b41d-377537bfa393 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.524587 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.525047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a9e49-7835-412c-b41d-377537bfa393 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.525510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a9e49-7835-412c-b41d-377537bfa393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.536986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:00.543289 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-db7a9e49-7835-412c-b41d-377537bfa393 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:00.544786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-db7a9e49-7835-412c-b41d-377537bfa393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:00.545236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 24 14:41:00.551787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 452/892] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:00.553002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.622538 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 441/893] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:00.638906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a9e49-7835-412c-b41d-377537bfa393 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.672584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ad990-8696-4b26-a431-b5b8ae0a4844 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.715176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e2f2-f7a8-4c0d-a38a-bb4ccd57b135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.716688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e2f2-f7a8-4c0d-a38a-bb4ccd57b135 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.717134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e2f2-f7a8-4c0d-a38a-bb4ccd57b135 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.717808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e2f2-f7a8-4c0d-a38a-bb4ccd57b135 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.718785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1e2f2-f7a8-4c0d-a38a-bb4ccd57b135 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:00.719255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1e2f2-f7a8-4c0d-a38a-bb4ccd57b135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:00.720932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1e2f2-f7a8-4c0d-a38a-bb4ccd57b135 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:00.729225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 453/894] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:00.730771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010462d-5569-4b8a-9921-a6d8355f4018 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.731216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010462d-5569-4b8a-9921-a6d8355f4018 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.731644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010462d-5569-4b8a-9921-a6d8355f4018 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.733698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 454/895] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:00.734639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010462d-5569-4b8a-9921-a6d8355f4018 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.755634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a9e49-7835-412c-b41d-377537bfa393 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.789730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235990e5-3d3a-4a57-a019-bb1d57630fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.790447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235990e5-3d3a-4a57-a019-bb1d57630fe7 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.790721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235990e5-3d3a-4a57-a019-bb1d57630fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.790995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235990e5-3d3a-4a57-a019-bb1d57630fe7 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.791715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235990e5-3d3a-4a57-a019-bb1d57630fe7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:00.793076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235990e5-3d3a-4a57-a019-bb1d57630fe7 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:00.806939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 442/896] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:41:00 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:41:00.808344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de2aa0-621d-41c9-a93b-c5bd69f14598 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.808631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de2aa0-621d-41c9-a93b-c5bd69f14598 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.808905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de2aa0-621d-41c9-a93b-c5bd69f14598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.826381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-98de2aa0-621d-41c9-a93b-c5bd69f14598 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:00.827826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-98de2aa0-621d-41c9-a93b-c5bd69f14598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:00.868163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010462d-5569-4b8a-9921-a6d8355f4018 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:00.913156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:00.914387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:00.914852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:00.915289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:00.922471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 443/897] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:00.928930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:00.930818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:00.940651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de2aa0-621d-41c9-a93b-c5bd69f14598 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:00.949638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:00.951696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 455/898] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:00.957530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.054575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de2aa0-621d-41c9-a93b-c5bd69f14598 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.080797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fb30-b2f8-4e13-bcba-572050e2db3e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.092150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.092952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.093303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.093645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.094452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.095908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.107218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 24 14:41:01.108797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 444/899] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:01.115219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.121354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.122021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.122381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.122657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.123485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:01.123788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.125148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.140067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 456/900] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:01.147536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.240521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c2768-333e-4fc0-b822-d384c78b37fc None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.256518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e8c4b-7a06-4c9b-8f4a-195878c8793a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.276526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.277497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.277972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.278486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.279333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:01.279776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.281305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.290948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 445/901] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:01.292204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.294702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.295771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.296165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.297204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.305262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.307215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.325181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 24 14:41:01.331385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 457/902] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:01.335000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.398239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c9a9c-71e2-4dcb-a50a-9fe1f694dace None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.430522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.431211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.431493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.431768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.432477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:01.432782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.434191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.439408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 446/903] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:01.444959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.455512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c3cfe-8206-4a6a-9a2f-7ab74cc8f128 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.497111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.498272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.499013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.499705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.500890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:01.501369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.503480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.525507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 458/904] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:01.531291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.550905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512b34e-9e27-4300-8384-79b5d387a750 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.592707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.594004 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.594565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.595040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.596194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] RBAC: Adding query filter params (interface=public, service_id=b0aa17a0cd364c90861aded1acf13024, region_id=RegionOne) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:01.597161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.599011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.609088 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 447/905] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/endpoints?service_id=b0aa17a0cd364c90861aded1acf13024&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:01.614391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.632993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60dc0-6ffe-4933-bdb5-4109fdfecb8f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.668061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.668693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.668974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.669248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.736980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.738409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b7842-a84e-4485-bf9e-f94684f6828e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:01.738800 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.778114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:01.779163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:01.779760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:01.780224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:01.781105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:01.782753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:01.789199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 448/906] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:41:01.853180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 459/907] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:41:01.858655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:01.970724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d119-ff3e-41d2-8a7a-89dbd9c1c40a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:02.007028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:02.007875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:02.008112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:02.008385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:02.019645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:02.021093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:02.037288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:02.038803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 449/908] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:02.044447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:02.148155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b145b9c-1208-4d86-b2b2-527d67aac71b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:02.181206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:02.181877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:02.182179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:02.182455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:02.183176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:02.183481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:02.184852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:02.196649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 460/909] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:02.202097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:02.302332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3490d-9094-4183-8e3a-bec66ec6595e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:02.335501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:02.336606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:02.337074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:02.337535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:02.344500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:02.346227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:02.359790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:41:02.361602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 450/910] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:02.367451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:02.464195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52555dfa-67a5-4fae-b21f-174e7093ecd2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:02.496872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141099c9-d8a6-4b45-ad17-9f02569b1475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:02.497871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141099c9-d8a6-4b45-ad17-9f02569b1475 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:02.498377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141099c9-d8a6-4b45-ad17-9f02569b1475 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:02.498849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141099c9-d8a6-4b45-ad17-9f02569b1475 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:02.499854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141099c9-d8a6-4b45-ad17-9f02569b1475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:02.500358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141099c9-d8a6-4b45-ad17-9f02569b1475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:02.502066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141099c9-d8a6-4b45-ad17-9f02569b1475 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:02.518968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 461/911] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:02.525668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:02.624168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90ab54-88e9-486f-bb2a-95e76b93db4f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:02.661283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8275e-620b-407d-bed9-738f16138f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:02.662279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8275e-620b-407d-bed9-738f16138f5c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:02.662736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8275e-620b-407d-bed9-738f16138f5c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:02.663211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8275e-620b-407d-bed9-738f16138f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:02.664273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8275e-620b-407d-bed9-738f16138f5c None admin] RBAC: Adding query filter params (role.id=3628de61442e449ab5c1c490cbaeb16f, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ac6e1bff8c1f44c38b86d3ebda419784) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:02.664765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8275e-620b-407d-bed9-738f16138f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:02.666495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8275e-620b-407d-bed9-738f16138f5c None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:02.672653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 451/912] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:02 2022] GET /identity/v3/role_assignments?user.id=ac6e1bff8c1f44c38b86d3ebda419784&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=3628de61442e449ab5c1c490cbaeb16f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:02.871824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48070-9dd0-49eb-bf3e-9f1fada7ad5f None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:02.872508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48070-9dd0-49eb-bf3e-9f1fada7ad5f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:02.872508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48070-9dd0-49eb-bf3e-9f1fada7ad5f None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:02.875148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 462/913] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:02.879955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d840-c8e1-4269-b244-5d04d80bfa77 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:02.880424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d840-c8e1-4269-b244-5d04d80bfa77 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:02.880500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9d840-c8e1-4269-b244-5d04d80bfa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:02.901957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-eaf9d840-c8e1-4269-b244-5d04d80bfa77 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:02.901957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-eaf9d840-c8e1-4269-b244-5d04d80bfa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:02.968889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 452/914] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:02.992717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48070-9dd0-49eb-bf3e-9f1fada7ad5f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.100803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48070-9dd0-49eb-bf3e-9f1fada7ad5f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:03.134640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83f5fc-ee0f-4577-b41f-8b6e3cf4cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:03.135400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83f5fc-ee0f-4577-b41f-8b6e3cf4cec3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.135695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83f5fc-ee0f-4577-b41f-8b6e3cf4cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.135971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83f5fc-ee0f-4577-b41f-8b6e3cf4cec3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.136676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83f5fc-ee0f-4577-b41f-8b6e3cf4cec3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:03.138049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83f5fc-ee0f-4577-b41f-8b6e3cf4cec3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:03.149352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-1d83f5fc-ee0f-4577-b41f-8b6e3cf4cec3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 24 14:41:03.150950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 463/915] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:41:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:03.156478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9d840-c8e1-4269-b244-5d04d80bfa77 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.199918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c5aee-aab9-4721-b380-4d565db74b17 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.200188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c5aee-aab9-4721-b380-4d565db74b17 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.200544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c5aee-aab9-4721-b380-4d565db74b17 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.202325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 464/916] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:03.208438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad7677-599e-426f-aa88-dd63a70cab4f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.208693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad7677-599e-426f-aa88-dd63a70cab4f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.209137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad7677-599e-426f-aa88-dd63a70cab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.227172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ddad7677-599e-426f-aa88-dd63a70cab4f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:03.228548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ddad7677-599e-426f-aa88-dd63a70cab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:03.272716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9d840-c8e1-4269-b244-5d04d80bfa77 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:03.301624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 465/917] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:03.310966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:03.311829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.312269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.312689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.313603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:03.314046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:03.315574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:03.320620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 453/918] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:41:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:03.327146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad7677-599e-426f-aa88-dd63a70cab4f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.330981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.438943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad7677-599e-426f-aa88-dd63a70cab4f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:03.446553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5f91f-1d46-4ec0-9356-57ef1eb4e977 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:03.482213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:03.483275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.483639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.483926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.484683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:03.486498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:03.488066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:03.488933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.489401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.489848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.490776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:03.491256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:03.492805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:03.498589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 24 14:41:03.499503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 454/919] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Mar 24 14:41:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:03.503960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 466/920] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:03.505792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.511611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.617362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb206d01-b681-481d-a2d9-e4f1e67d8c36 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:03.633247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64b1b8-fb93-4269-972b-6f35879a927e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:03.654177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:03.655082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.655529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.655947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.656904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:03.659299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:03.671276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:03.672137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.672648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.672987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.674062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:03.674475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:03.675900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:03.684488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 467/921] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:03.690310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 455/922] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:41:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:41:03.691457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.804202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925cf8-d70c-4c66-ad7f-cb848fd25a9e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:03.848870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:03.850013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:03.850549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:03.851057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:03.851990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:03.852504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:03.854153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:03.863821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 468/923] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:03.867086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:03.974161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdfb04-26a4-4342-8c5f-d5d35f3c8263 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:04.007895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15c5db-f51e-4758-8cd5-06f28b8cdfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:04.008565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15c5db-f51e-4758-8cd5-06f28b8cdfc0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.008846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15c5db-f51e-4758-8cd5-06f28b8cdfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.009121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15c5db-f51e-4758-8cd5-06f28b8cdfc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.009909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15c5db-f51e-4758-8cd5-06f28b8cdfc0 None admin] RBAC: Adding query filter params (interface=public, service_id=6249045da4ee418b839bbf6fb21ec48b, region_id=RegionOne) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:04.010249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15c5db-f51e-4758-8cd5-06f28b8cdfc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:04.011626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15c5db-f51e-4758-8cd5-06f28b8cdfc0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:04.017039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 456/924] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:41:03 2022] GET /identity/v3/endpoints?service_id=6249045da4ee418b839bbf6fb21ec48b&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:04.022806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:04.122491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c81ec-c165-4577-9fbf-687e37998c7b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:04.156039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:04.157131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.157648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.158147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.159040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:04.160610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:04.166766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b681-aecb-4890-a53f-902142afb718 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.167057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b681-aecb-4890-a53f-902142afb718 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.167339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b681-aecb-4890-a53f-902142afb718 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.171073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 457/926] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:04.171375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 469/926] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:41:04 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:41:04.175418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7274e-1cfd-49cd-b916-96cb93f8f546 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.175708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7274e-1cfd-49cd-b916-96cb93f8f546 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.175988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7274e-1cfd-49cd-b916-96cb93f8f546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.194642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-41c7274e-1cfd-49cd-b916-96cb93f8f546 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:04.195871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-41c7274e-1cfd-49cd-b916-96cb93f8f546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:04.269620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 458/927] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:04.292818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:04.410877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e9f80-e981-4651-8fc8-98c9c116454b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:04.448409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:04.449640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.450148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.450749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.451603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:04.453187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:04.465343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 24 14:41:04.467212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 470/928] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Mar 24 14:41:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:04.474106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7274e-1cfd-49cd-b916-96cb93f8f546 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:04.570472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7274e-1cfd-49cd-b916-96cb93f8f546 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:04.609592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:04.610711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.611212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.611698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.612617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:04.613128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:04.614718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:04.620395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 459/929] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:04.627211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:04.732290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612e92-6a9a-45e6-8639-effe82d45697 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:04.765931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c9583-5813-473c-a1e9-d92947a106e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:04.766679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9583-5813-473c-a1e9-d92947a106e0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.767207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9583-5813-473c-a1e9-d92947a106e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.767486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9583-5813-473c-a1e9-d92947a106e0 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.768197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c9583-5813-473c-a1e9-d92947a106e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:04.768499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c9583-5813-473c-a1e9-d92947a106e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:04.769868 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c9583-5813-473c-a1e9-d92947a106e0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:04.775197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 471/930] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:04.782363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:04.883162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ca85-4111-4d07-be59-96db0692d49d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:04.922045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374f2fd-6767-484b-a307-6ed0be81c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:04.922792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374f2fd-6767-484b-a307-6ed0be81c119 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:04.923078 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374f2fd-6767-484b-a307-6ed0be81c119 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:04.923357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374f2fd-6767-484b-a307-6ed0be81c119 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:04.924120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374f2fd-6767-484b-a307-6ed0be81c119 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:04.925489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374f2fd-6767-484b-a307-6ed0be81c119 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:04.947302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 460/931] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:41:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:05.067836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d1e88-ca47-4895-a063-e68abb64c616 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:05.068360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d1e88-ca47-4895-a063-e68abb64c616 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:05.068445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d1e88-ca47-4895-a063-e68abb64c616 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:05.070599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 472/932] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:05.076359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad88214-b4bd-48a8-b259-c836a9496b97 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:05.076863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad88214-b4bd-48a8-b259-c836a9496b97 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:05.077101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad88214-b4bd-48a8-b259-c836a9496b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:05.096718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-0ad88214-b4bd-48a8-b259-c836a9496b97 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:05.097927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0ad88214-b4bd-48a8-b259-c836a9496b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:05.178360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 461/933] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:05.201134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d1e88-ca47-4895-a063-e68abb64c616 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:05.306215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d1e88-ca47-4895-a063-e68abb64c616 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:05.339463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:05.340579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:05.341027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:05.341491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:05.352163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:05.359912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 24 14:41:05.366233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 473/934] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Mar 24 14:41:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:05.367785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad88214-b4bd-48a8-b259-c836a9496b97 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:05.470723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad88214-b4bd-48a8-b259-c836a9496b97 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:05.506045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:05.506749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:05.507031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:05.507307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:05.508063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:05.508370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:05.510003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:05.518472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 462/935] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Mar 24 14:41:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:05.524585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:05.624741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370da0a-fd30-4c1c-9254-6a7517c30afb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:05.658007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:05.658834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:05.659113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:05.659384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:05.669400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:05.670894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:05.687340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:05.688898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 474/936] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:05.695221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:05.799301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ef27-5376-4678-b133-1ed81c77c548 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:05.834121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:05.834801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:05.835079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:05.835353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:05.836084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:05.836384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:05.837767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:05.850410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 463/937] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:05.859371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:05.956125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d2aa-be0a-4073-addc-d11fc65e8382 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:05.991016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c706f-4fdd-4def-8515-186a8bb7b59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:05.991840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c706f-4fdd-4def-8515-186a8bb7b59e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:05.992118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c706f-4fdd-4def-8515-186a8bb7b59e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:05.992387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c706f-4fdd-4def-8515-186a8bb7b59e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.000736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c706f-4fdd-4def-8515-186a8bb7b59e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.002418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c706f-4fdd-4def-8515-186a8bb7b59e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.016227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-e19c706f-4fdd-4def-8515-186a8bb7b59e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 24 14:41:06.017718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 475/938] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:41:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:06.023483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.127818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea208b26-beb0-4498-a302-518d242f7c32 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.161500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.161820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fd933-65fe-4c32-be7e-4319cbd0a893 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.162293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fd933-65fe-4c32-be7e-4319cbd0a893 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.162378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.162454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fd933-65fe-4c32-be7e-4319cbd0a893 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.162526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.162732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.163566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:06.163874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.164315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 476/939] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:06.165342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.169255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c5a9c-26e4-43d1-b207-3c0e2ce9616a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.169534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c5a9c-26e4-43d1-b207-3c0e2ce9616a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.169809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c5a9c-26e4-43d1-b207-3c0e2ce9616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.184864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 464/940] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:06.186943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-dd3c5a9c-26e4-43d1-b207-3c0e2ce9616a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:06.188166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dd3c5a9c-26e4-43d1-b207-3c0e2ce9616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:06.191037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.262204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 477/941] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:06.279428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c5a9c-26e4-43d1-b207-3c0e2ce9616a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.307792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd10eec-d294-401b-bd1d-09c9e46c1717 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.341056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.342192 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.342668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.343151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.353410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.355112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.372971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:06.378642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 465/942] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:06.381393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.388889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c5a9c-26e4-43d1-b207-3c0e2ce9616a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.432604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.433274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.433649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.433924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.434657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.436804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.438400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.common [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 24 14:41:06.460305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.sql.core [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 24 14:41:06.460305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 24 14:41:06.460305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [parameters: {'id': 'a7e32dc80aee4176a5f5e8345092cbab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 24 14:41:06.460305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 24 14:41:06.468899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7e32dc80aee4176a5f5e8345092cbab.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7e32dc80aee4176a5f5e8345092cbab. Mar 24 14:41:06.470622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 478/943] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Mar 24 14:41:06 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:06.477149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.493316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf4e9d-da56-493c-9c9f-aeb9dfd4e6b2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.534223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.535122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.535936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.536379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.537495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:06.537937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.540137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.555788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 466/944] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:06.563211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.587770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58854f-2f14-4607-bbb0-6b0167265d7e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.621179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.622278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.622694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.623128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.630178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.632074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.645983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:41:06.647843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 479/945] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:06.654651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.679734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20d98-2101-43a4-989f-6b2f67d49b02 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.713424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658ff6f-8fac-4efc-95b5-f56168a438e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.714264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ff6f-8fac-4efc-95b5-f56168a438e7 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.714542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ff6f-8fac-4efc-95b5-f56168a438e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.714812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ff6f-8fac-4efc-95b5-f56168a438e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.721567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658ff6f-8fac-4efc-95b5-f56168a438e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.723050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658ff6f-8fac-4efc-95b5-f56168a438e7 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.736998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-7658ff6f-8fac-4efc-95b5-f56168a438e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:41:06.741371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 467/946] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:06.742713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990b78-ff8e-41c5-bf59-0e4cab0e29b1 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.743285 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990b78-ff8e-41c5-bf59-0e4cab0e29b1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.743569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990b78-ff8e-41c5-bf59-0e4cab0e29b1 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.745900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 468/947] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:06.746686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990b78-ff8e-41c5-bf59-0e4cab0e29b1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.781370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79195c06-2c6c-4639-85f6-0aeeb7520f2b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.815490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4be21f-5f7b-4c15-9f72-5c3157d205b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.816322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4be21f-5f7b-4c15-9f72-5c3157d205b9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.816613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4be21f-5f7b-4c15-9f72-5c3157d205b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.816887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4be21f-5f7b-4c15-9f72-5c3157d205b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.817645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4be21f-5f7b-4c15-9f72-5c3157d205b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:06.817950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4be21f-5f7b-4c15-9f72-5c3157d205b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.819412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4be21f-5f7b-4c15-9f72-5c3157d205b9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.839336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 480/948] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:06.840650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f67b6-1b29-40de-8766-25af2c76d8e5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.840938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f67b6-1b29-40de-8766-25af2c76d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.841212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f67b6-1b29-40de-8766-25af2c76d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.858696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990b78-ff8e-41c5-bf59-0e4cab0e29b1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:06.859193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-873f67b6-1b29-40de-8766-25af2c76d8e5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:06.860890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-873f67b6-1b29-40de-8766-25af2c76d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:06.915443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:06.916533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:06.916841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:06.917097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:06.917918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:06.918256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:06.920207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:06.937259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 469/949] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:06.943405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:06.947168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 481/950] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:06.978183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f67b6-1b29-40de-8766-25af2c76d8e5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:07.052378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fecd44-c220-496f-8501-7eaea75645f6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.089272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f67b6-1b29-40de-8766-25af2c76d8e5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.091662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.092787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.093258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.094032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/ac6e1bff8c1f44c38b86d3ebda419784/roles/3628de61442e449ab5c1c490cbaeb16f` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.097119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=ac6e1bff8c1f44c38b86d3ebda419784, role_id=3628de61442e449ab5c1c490cbaeb16f)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.098606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.117101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 470/951] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:41:06 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/ac6e1bff8c1f44c38b86d3ebda419784/roles/3628de61442e449ab5c1c490cbaeb16f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:41:07.132836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751f69-380f-4e4e-ad8b-4a1094abe43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.133792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751f69-380f-4e4e-ad8b-4a1094abe43b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.134285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751f69-380f-4e4e-ad8b-4a1094abe43b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.134571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751f69-380f-4e4e-ad8b-4a1094abe43b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.135243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7751f69-380f-4e4e-ad8b-4a1094abe43b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.136927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7751f69-380f-4e4e-ad8b-4a1094abe43b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.150073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c7751f69-380f-4e4e-ad8b-4a1094abe43b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 24 14:41:07.151917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 482/952] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:07.157914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:07.271453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff24aa-fe5b-49ac-ace9-724f42914121 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.307240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.307440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30478-f0b6-4761-8df3-a29a97d873f5 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.307844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30478-f0b6-4761-8df3-a29a97d873f5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.308081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded30478-f0b6-4761-8df3-a29a97d873f5 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.308193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.308273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.308500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.309239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:07.309546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.310022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 483/953] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:07.310960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.315698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3850d1-68d9-430e-89a9-8132de37162e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.315980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3850d1-68d9-430e-89a9-8132de37162e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.316375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3850d1-68d9-430e-89a9-8132de37162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.316494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 471/954] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:07.323917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:07.334216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-6a3850d1-68d9-430e-89a9-8132de37162e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:07.335700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6a3850d1-68d9-430e-89a9-8132de37162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:07.410477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 484/955] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:07.433024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef984af0-44b9-457a-94bb-e5669ee81104 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.437441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3850d1-68d9-430e-89a9-8132de37162e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:07.474423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.475068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.475347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.475618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.476325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:07.476627 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.477978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.485812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 472/956] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:07.491610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:07.544610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3850d1-68d9-430e-89a9-8132de37162e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.577950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.578836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.579114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.579389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.580350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.581813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.589778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331c8a0-9181-41a4-93bd-c8aa2cecf6ce None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.592975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 24 14:41:07.598762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 485/957] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:07.600030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:07.624224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.625298 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.625814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.626322 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.627313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.628925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.658553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 473/958] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:41:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:41:07.707662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328db30-cf85-497c-a545-1728b3579f41 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.750111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f04778-b7d3-4311-85ad-86fa0914e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.750972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04778-b7d3-4311-85ad-86fa0914e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.751305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04778-b7d3-4311-85ad-86fa0914e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.751678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04778-b7d3-4311-85ad-86fa0914e3d6 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.752394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f04778-b7d3-4311-85ad-86fa0914e3d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:07.752739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f04778-b7d3-4311-85ad-86fa0914e3d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.754174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f04778-b7d3-4311-85ad-86fa0914e3d6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.763968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 486/959] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:41:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:07.765967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:07.873844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a891e-39f3-4b10-84dd-9670ad83894f None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:07.905936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681e315-a4df-4ad5-b5ef-a4db610db50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:07.906629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e315-a4df-4ad5-b5ef-a4db610db50b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:07.906984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e315-a4df-4ad5-b5ef-a4db610db50b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:07.907254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e315-a4df-4ad5-b5ef-a4db610db50b None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:07.907959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681e315-a4df-4ad5-b5ef-a4db610db50b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:07.908261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681e315-a4df-4ad5-b5ef-a4db610db50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:07.909624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681e315-a4df-4ad5-b5ef-a4db610db50b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:07.914199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 474/960] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:41:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:09.267534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47472-7fbf-4cb4-bba5-82db77fefca3 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.268035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47472-7fbf-4cb4-bba5-82db77fefca3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.268035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47472-7fbf-4cb4-bba5-82db77fefca3 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.270042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 487/961] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:09.275473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3217-3b59-4472-a581-c03d7a19d438 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.275865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3217-3b59-4472-a581-c03d7a19d438 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.276055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d3217-3b59-4472-a581-c03d7a19d438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.292977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b25d3217-3b59-4472-a581-c03d7a19d438 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:09.294158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b25d3217-3b59-4472-a581-c03d7a19d438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:09.366190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 475/962] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:09.384488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a47472-7fbf-4cb4-bba5-82db77fefca3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:09.482004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a47472-7fbf-4cb4-bba5-82db77fefca3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:09.490215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466898d0-1240-4a21-80bc-d3dc64b0a20a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.490504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466898d0-1240-4a21-80bc-d3dc64b0a20a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.490771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466898d0-1240-4a21-80bc-d3dc64b0a20a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.492971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 476/963] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:09.498232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bea63-dada-4622-9fa5-14fbce12599f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.498517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bea63-dada-4622-9fa5-14fbce12599f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.498789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bea63-dada-4622-9fa5-14fbce12599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.515797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e89bea63-dada-4622-9fa5-14fbce12599f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:09.516976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e89bea63-dada-4622-9fa5-14fbce12599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:09.518325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:09.519199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.519651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.520096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.520972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:09.522651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:09.538054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.sql.core [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 24 14:41:09.538054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 24 14:41:09.538054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [parameters: {'user_id': 'fb0308dcb8614309a1cc8588ef31e803', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 24 14:41:09.538054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86182) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 24 14:41:09.544464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 24 14:41:09.546370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 488/964] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Mar 24 14:41:09 2022] POST /identity/v3/users => generated 160 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:09.552811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:09.610258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 477/965] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:09.634749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bea63-dada-4622-9fa5-14fbce12599f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:09.676558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadf76-2c2f-4a69-9c24-5c2d806fc207 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:09.720248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:09.721405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.722287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.722758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.733189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:09.734678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bea63-dada-4622-9fa5-14fbce12599f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:09.735474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:09.753118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 24 14:41:09.759620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 489/966] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:41:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:09.761151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:09.772724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:09.773651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.774468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.774468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.784939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:09.792612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 24 14:41:09.798798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 478/967] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Mar 24 14:41:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:09.800593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:09.875066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0de9cd-ce2e-40d0-96d3-cd8cbd4abef9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:09.902480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762f84-c605-4b14-b01c-a196ab78ca60 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:09.911067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:09.911752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.912511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.912511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.913110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:09.913412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:09.914927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:09.939477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28c580-d328-4eac-85d2-9c04e62d30c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:09.940503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c580-d328-4eac-85d2-9c04e62d30c1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:09.940988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c580-d328-4eac-85d2-9c04e62d30c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:09.941484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28c580-d328-4eac-85d2-9c04e62d30c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:09.942441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28c580-d328-4eac-85d2-9c04e62d30c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:09.942933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28c580-d328-4eac-85d2-9c04e62d30c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:09.944503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28c580-d328-4eac-85d2-9c04e62d30c1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:09.957057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 490/969] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Mar 24 14:41:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:09.957330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 479/969] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Mar 24 14:41:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:09.967245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.026698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923806-124e-4201-8962-d476b83826da None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.026883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923806-124e-4201-8962-d476b83826da None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.027196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11923806-124e-4201-8962-d476b83826da None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.029496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 480/970] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:10.035460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdcf9-379c-457c-b5af-a023a246a955 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.035754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdcf9-379c-457c-b5af-a023a246a955 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.036010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cdcf9-379c-457c-b5af-a023a246a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.053253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-126cdcf9-379c-457c-b5af-a023a246a955 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:10.054498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-126cdcf9-379c-457c-b5af-a023a246a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:10.076499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d467d-ac76-4bf7-9671-4e0670c19766 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.116216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.117142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.117422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.117692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.131864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.133660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.135021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 481/971] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:10.157201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdcf9-379c-457c-b5af-a023a246a955 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.158475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:10.161420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 491/972] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:10.170902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.275200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cdcf9-379c-457c-b5af-a023a246a955 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.281798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99307679-73a9-4239-a4f2-96d52c901a7e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.307412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8286-2fa0-4efb-8045-5cf9156e961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.308217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8286-2fa0-4efb-8045-5cf9156e961b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.308496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8286-2fa0-4efb-8045-5cf9156e961b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.308768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8286-2fa0-4efb-8045-5cf9156e961b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.309418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8286-2fa0-4efb-8045-5cf9156e961b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.310817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8286-2fa0-4efb-8045-5cf9156e961b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.313704 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c02ad-b54d-4d8e-8cf6-946970a5375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.314446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c02ad-b54d-4d8e-8cf6-946970a5375f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.314738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c02ad-b54d-4d8e-8cf6-946970a5375f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.315010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c02ad-b54d-4d8e-8cf6-946970a5375f None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.315721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c02ad-b54d-4d8e-8cf6-946970a5375f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:10.316025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c02ad-b54d-4d8e-8cf6-946970a5375f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.317374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c02ad-b54d-4d8e-8cf6-946970a5375f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.321888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-a96e8286-2fa0-4efb-8045-5cf9156e961b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 24 14:41:10.323077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 482/973] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:10.324277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed45e-7de6-4705-bf52-a22e6343d19c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.324525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed45e-7de6-4705-bf52-a22e6343d19c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.324794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed45e-7de6-4705-bf52-a22e6343d19c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.326647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 483/974] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:10.329029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed45e-7de6-4705-bf52-a22e6343d19c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.330511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 492/975] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:10.332122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135ae7-611c-4e72-b3d8-6ff5fbb15b23 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.332411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135ae7-611c-4e72-b3d8-6ff5fbb15b23 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.332690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6135ae7-611c-4e72-b3d8-6ff5fbb15b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.348759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f6135ae7-611c-4e72-b3d8-6ff5fbb15b23 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:10.350305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f6135ae7-611c-4e72-b3d8-6ff5fbb15b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:10.414004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 493/976] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:10.415081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6135ae7-611c-4e72-b3d8-6ff5fbb15b23 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.423116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed45e-7de6-4705-bf52-a22e6343d19c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.456287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.456945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.457225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.457476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.458217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:10.458518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.459877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.464426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 484/977] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:10.465166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.509185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6135ae7-611c-4e72-b3d8-6ff5fbb15b23 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.543075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.543857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.544138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.544406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.551328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.552782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.559097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e492-73cc-4061-80cf-937c9d5b3e96 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.566485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 24 14:41:10.567650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 494/978] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:10.572271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.595571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.596237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.596522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.596826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.597529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.598915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.612170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 485/979] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:41:10 2022] POST /identity/v3/services => generated 242 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:10.612982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.665633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3953113-c1ec-4fe2-b8cd-576d0c48c7b5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.712522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.713209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.713508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.713775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.714519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:10.714818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.716209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.721557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 495/980] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:10.724994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eed05-ad2e-4e5a-86ec-a93a8180bc77 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.727485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.760524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.761244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.761515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.761792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.762675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:10.762983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.764446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.783179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 486/981] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:10.788598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.831731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30034-8cda-41f0-b187-cf51f9431ae1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.869787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.870481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.870758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.871072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.871843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] RBAC: Adding query filter params (interface=admin, service_id=6249045da4ee418b839bbf6fb21ec48b, region_id=RegionOne) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:10.872163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.873505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:10.879046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 496/982] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/endpoints?service_id=6249045da4ee418b839bbf6fb21ec48b&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:10.884084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:10.888872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fce25-ba91-4b4d-81ca-a3afdcf347d0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.921414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:10.922061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:10.922397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:10.922669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:10.986235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214ba2d-ed47-480e-a020-f35522767760 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:10.987421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:10.988880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:11.023588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:11.024444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:11.024839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:11.025237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:11.026365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:11.028221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:11.035273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 497/983] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:41:11.090261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 487/984] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:10 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:41:11.095926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:11.201582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56feaad3-c369-4346-8c80-b25a9425bcf9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:11.237750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:11.238558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:11.238836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:11.239111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:11.249122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:11.250653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:11.267206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:11.269480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 498/985] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:11.274500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:11.374278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ff79a-f09a-42aa-aa83-03eb5b0c4c13 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:11.409244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:11.410274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:11.410791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:11.411246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:11.412190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:11.412666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:11.414257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:11.426377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 488/986] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:11.431908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:11.530657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e262669-5070-457e-a81c-192ca500a267 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:11.565191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:11.566266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:11.566724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:11.567167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:11.573862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:11.575549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:11.588982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:41:11.590379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 499/987] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:11.596495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:11.694837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632cfa-d596-44eb-923a-26dd23063eb0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:11.728732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f59046-8dc3-4e50-ad3f-cfd35ef2db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:11.729410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59046-8dc3-4e50-ad3f-cfd35ef2db17 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:11.729695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59046-8dc3-4e50-ad3f-cfd35ef2db17 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:11.729966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f59046-8dc3-4e50-ad3f-cfd35ef2db17 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:11.730842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f59046-8dc3-4e50-ad3f-cfd35ef2db17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:11.731157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f59046-8dc3-4e50-ad3f-cfd35ef2db17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:11.732641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f59046-8dc3-4e50-ad3f-cfd35ef2db17 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:11.746127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 489/988] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:11.752004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:11.852548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66640561-905b-47c7-8809-39a6b8140a01 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:11.891279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7d702-4402-4037-87ba-e3536202e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:11.891931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7d702-4402-4037-87ba-e3536202e8bc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:11.892213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7d702-4402-4037-87ba-e3536202e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:11.892469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7d702-4402-4037-87ba-e3536202e8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:11.893290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7d702-4402-4037-87ba-e3536202e8bc None admin] RBAC: Adding query filter params (role.id=3628de61442e449ab5c1c490cbaeb16f, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ac6e1bff8c1f44c38b86d3ebda419784) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:11.893603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7d702-4402-4037-87ba-e3536202e8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:11.895076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7d702-4402-4037-87ba-e3536202e8bc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:11.905505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 500/989] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:11 2022] GET /identity/v3/role_assignments?user.id=ac6e1bff8c1f44c38b86d3ebda419784&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=3628de61442e449ab5c1c490cbaeb16f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:12.880725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd7cc0-80f4-4d31-be9f-d5b32f87c032 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:12.883603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd7cc0-80f4-4d31-be9f-d5b32f87c032 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:12.883603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd7cc0-80f4-4d31-be9f-d5b32f87c032 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:12.883603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 490/990] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:12.888277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b96f-8d0d-4abe-ac8a-1f4de37d8c1a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:12.888735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b96f-8d0d-4abe-ac8a-1f4de37d8c1a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:12.888818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b96f-8d0d-4abe-ac8a-1f4de37d8c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:12.905960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c673b96f-8d0d-4abe-ac8a-1f4de37d8c1a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:12.907270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c673b96f-8d0d-4abe-ac8a-1f4de37d8c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:12.976932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 501/991] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:12.999456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd7cc0-80f4-4d31-be9f-d5b32f87c032 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.100760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd7cc0-80f4-4d31-be9f-d5b32f87c032 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.134054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.134787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.135070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.135296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.135976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.137330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.148026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 24 14:41:13.149356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 491/992] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:13.155217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b96f-8d0d-4abe-ac8a-1f4de37d8c1a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.251813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b96f-8d0d-4abe-ac8a-1f4de37d8c1a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.284564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccef7a3-fdc3-4451-861d-e4eb609653a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.285216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccef7a3-fdc3-4451-861d-e4eb609653a9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.285470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccef7a3-fdc3-4451-861d-e4eb609653a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.285767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccef7a3-fdc3-4451-861d-e4eb609653a9 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.286492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccef7a3-fdc3-4451-861d-e4eb609653a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:13.286790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccef7a3-fdc3-4451-861d-e4eb609653a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.288150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccef7a3-fdc3-4451-861d-e4eb609653a9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.293097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 502/993] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:41:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:13.298625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.316527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3afa8-1f7a-49ac-9584-33ab227084c0 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.316807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3afa8-1f7a-49ac-9584-33ab227084c0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.317101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3afa8-1f7a-49ac-9584-33ab227084c0 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.319003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 503/994] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:13.323591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023cee-1e7e-4ee6-9ac9-6f9bc4550828 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.323877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023cee-1e7e-4ee6-9ac9-6f9bc4550828 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.324154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f023cee-1e7e-4ee6-9ac9-6f9bc4550828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.344273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-4f023cee-1e7e-4ee6-9ac9-6f9bc4550828 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:13.346068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4f023cee-1e7e-4ee6-9ac9-6f9bc4550828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:13.396873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6962a-a24e-430f-ab45-dc168df80696 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.416300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 504/995] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:13.433624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.434333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.434615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.434890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.435600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:13.435903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.437267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.439051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023cee-1e7e-4ee6-9ac9-6f9bc4550828 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.443412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 492/996] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:41:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:13.448871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.532818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f023cee-1e7e-4ee6-9ac9-6f9bc4550828 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.548081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e39bc-0d21-4af9-ab20-310d8fec4de2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.565933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.566777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.567063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.567341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.568000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.569376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.580743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 24 14:41:13.582069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 505/997] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Mar 24 14:41:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:13.582235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.582851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.583135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.583412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.584199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] RBAC: Adding query filter params (interface=public, service_id=3c49f4dd9fd74b73ad7a7f72d162be41, region_id=RegionOne) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:13.584516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.585886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.587625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.591493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 493/998] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:41:13 2022] GET /identity/v3/endpoints?service_id=3c49f4dd9fd74b73ad7a7f72d162be41&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:13.596399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.680901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda52a1-edf9-4b6a-a003-b845102a77d9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.688831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7e694-8734-4f39-be3f-1890db988fb6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.712365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.713033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.713314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.713597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.714323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:13.714629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.716000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.725200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 506/999] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:13.725379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.725379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.725379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.725379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.725738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.725738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.726229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.731687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 494/1000] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:41:13 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:41:13.827610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da614e-8565-4595-afdd-8b98ec6acb6a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:13.869445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98c89a-3ae1-4442-b2cc-7a5cab90b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:13.870143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98c89a-3ae1-4442-b2cc-7a5cab90b75d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:13.870453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98c89a-3ae1-4442-b2cc-7a5cab90b75d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:13.870703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98c89a-3ae1-4442-b2cc-7a5cab90b75d None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:13.871469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98c89a-3ae1-4442-b2cc-7a5cab90b75d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:13.871780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98c89a-3ae1-4442-b2cc-7a5cab90b75d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:13.873237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98c89a-3ae1-4442-b2cc-7a5cab90b75d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:13.884228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 507/1001] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Mar 24 14:41:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:13.885586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:13.985321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183c1fc-7dc9-4c06-8743-02f87114f2c9 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:14.018723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152af5d-4745-4d2c-98dd-d4f6c3c1a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:14.019382 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152af5d-4745-4d2c-98dd-d4f6c3c1a9e3 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:14.019659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152af5d-4745-4d2c-98dd-d4f6c3c1a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:14.019931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152af5d-4745-4d2c-98dd-d4f6c3c1a9e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:14.020682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152af5d-4745-4d2c-98dd-d4f6c3c1a9e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:14.022029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152af5d-4745-4d2c-98dd-d4f6c3c1a9e3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:14.038146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 495/1002] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:41:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:14.269895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedc465-91b3-41b9-91ab-9388c4604dd3 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:14.270454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedc465-91b3-41b9-91ab-9388c4604dd3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:14.270454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedc465-91b3-41b9-91ab-9388c4604dd3 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:14.272333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 508/1003] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:14.277522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579721-68c2-4613-a48e-eb79960f6385 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:14.277818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579721-68c2-4613-a48e-eb79960f6385 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:14.278069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579721-68c2-4613-a48e-eb79960f6385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:14.294942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-fe579721-68c2-4613-a48e-eb79960f6385 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:14.296109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fe579721-68c2-4613-a48e-eb79960f6385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:14.368202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 496/1004] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:14.394983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedc465-91b3-41b9-91ab-9388c4604dd3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:14.514830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedc465-91b3-41b9-91ab-9388c4604dd3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:14.548016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:14.548727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:14.548981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:14.549283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] PATH_INFO: `/v3/services/image` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:14.549919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:14.551340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:14.561823 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 24 14:41:14.563243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 509/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Mar 24 14:41:14 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:14.569243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579721-68c2-4613-a48e-eb79960f6385 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:14.663475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579721-68c2-4613-a48e-eb79960f6385 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:14.696637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c737-043e-46e9-a773-d87d28cde061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:14.697295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c737-043e-46e9-a773-d87d28cde061 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:14.697578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c737-043e-46e9-a773-d87d28cde061 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:14.697846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c737-043e-46e9-a773-d87d28cde061 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:14.698592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c737-043e-46e9-a773-d87d28cde061 None admin] RBAC: Adding query filter params (name=image) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:14.698897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c737-043e-46e9-a773-d87d28cde061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:14.700242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c737-043e-46e9-a773-d87d28cde061 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:14.705760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 497/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:14.711286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:14.812810 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f94c-6bce-4390-b1c0-6424c384590a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:14.846301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c057c3-a548-4563-87db-37742d1286c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:14.846970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c057c3-a548-4563-87db-37742d1286c0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:14.847249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c057c3-a548-4563-87db-37742d1286c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:14.847522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c057c3-a548-4563-87db-37742d1286c0 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:14.848228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c057c3-a548-4563-87db-37742d1286c0 None admin] RBAC: Adding query filter params (type=image) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:14.848532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c057c3-a548-4563-87db-37742d1286c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:14.849898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c057c3-a548-4563-87db-37742d1286c0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:14.854762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 510/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:16.039610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ded1fe-ca56-4f99-a91e-be5e805eb029 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.040173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ded1fe-ca56-4f99-a91e-be5e805eb029 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.040173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ded1fe-ca56-4f99-a91e-be5e805eb029 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.041901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 498/1008] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:16.047327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539d255-b8db-4147-912b-a7f598c22f27 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.047769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539d255-b8db-4147-912b-a7f598c22f27 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.047859 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539d255-b8db-4147-912b-a7f598c22f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.064978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8539d255-b8db-4147-912b-a7f598c22f27 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:16.066144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8539d255-b8db-4147-912b-a7f598c22f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:16.131667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 511/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:16.154722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ded1fe-ca56-4f99-a91e-be5e805eb029 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:16.255135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ded1fe-ca56-4f99-a91e-be5e805eb029 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:16.287354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddfd74-5290-4a4a-8d72-97d39433d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:16.288153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfd74-5290-4a4a-8d72-97d39433d023 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.288432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfd74-5290-4a4a-8d72-97d39433d023 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.288688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddfd74-5290-4a4a-8d72-97d39433d023 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.289362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddfd74-5290-4a4a-8d72-97d39433d023 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:16.290746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddfd74-5290-4a4a-8d72-97d39433d023 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:16.301483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-70ddfd74-5290-4a4a-8d72-97d39433d023 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 24 14:41:16.302921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 499/1010] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:16.308670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539d255-b8db-4147-912b-a7f598c22f27 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:16.319315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c7c52-0dd4-4174-b481-0336ccd93af1 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.319584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c7c52-0dd4-4174-b481-0336ccd93af1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.319869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c7c52-0dd4-4174-b481-0336ccd93af1 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.321761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 500/1011] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:16.326461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf065-7bed-46d6-a96f-b6545b888509 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.326741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf065-7bed-46d6-a96f-b6545b888509 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.327012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf065-7bed-46d6-a96f-b6545b888509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.344534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-55daf065-7bed-46d6-a96f-b6545b888509 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:16.345934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-55daf065-7bed-46d6-a96f-b6545b888509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:16.408377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539d255-b8db-4147-912b-a7f598c22f27 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:16.412657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 501/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:16.435665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daf065-7bed-46d6-a96f-b6545b888509 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:16.440584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:16.441246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.441540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.441812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.442542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] RBAC: Adding query filter params (name=compute) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:16.442845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:16.444209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:16.453882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 512/1013] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:41:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:16.455080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:16.529779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daf065-7bed-46d6-a96f-b6545b888509 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:16.554057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d5a2-ec3c-4162-8e6a-de9ff6786eae None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:16.562556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:16.563394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.563673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.563942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.565115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:16.566575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:16.570117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 502/1014] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:16.573716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:16.592062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:16.592718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.592994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.593267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.593973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:16.594300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:16.595661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:16.600486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 513/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Mar 24 14:41:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:16.606093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:16.677232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172439-5fb9-4747-935c-bc3fb5381466 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:16.700374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a28fab-0ae5-42e4-a421-c8cfdf989a6d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:16.711414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d5c9b-b0b7-4afe-8254-c26458057fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:16.712073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d5c9b-b0b7-4afe-8254-c26458057fb6 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.712352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d5c9b-b0b7-4afe-8254-c26458057fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.712623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d5c9b-b0b7-4afe-8254-c26458057fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.713330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d5c9b-b0b7-4afe-8254-c26458057fb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:16.714779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d5c9b-b0b7-4afe-8254-c26458057fb6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:16.733836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20126f-2350-4655-a7f9-d974f90dc8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:16.734735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20126f-2350-4655-a7f9-d974f90dc8ae None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:16.734925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20126f-2350-4655-a7f9-d974f90dc8ae None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:16.735203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20126f-2350-4655-a7f9-d974f90dc8ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:16.735939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20126f-2350-4655-a7f9-d974f90dc8ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:16.737314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20126f-2350-4655-a7f9-d974f90dc8ae None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:16.750212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 503/1016] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:41:16 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:16.768949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 514/1017] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:41:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:41:17.117128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a24fe-b843-4340-b0c9-479982a6439d None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:17.117684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a24fe-b843-4340-b0c9-479982a6439d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:17.117684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a24fe-b843-4340-b0c9-479982a6439d None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:17.119618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 504/1018] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:17.124560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d66b2-1d80-4135-afc7-12b68e8a4ef3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:17.124984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d66b2-1d80-4135-afc7-12b68e8a4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:17.125193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d66b2-1d80-4135-afc7-12b68e8a4ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:17.141797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e46d66b2-1d80-4135-afc7-12b68e8a4ef3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:17.142987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e46d66b2-1d80-4135-afc7-12b68e8a4ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:17.215140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 515/1019] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:17.237378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a24fe-b843-4340-b0c9-479982a6439d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:17.337518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a24fe-b843-4340-b0c9-479982a6439d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:17.370202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71970de-908b-4cee-914b-88623acabb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:17.370871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71970de-908b-4cee-914b-88623acabb1b None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:17.371155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71970de-908b-4cee-914b-88623acabb1b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:17.371466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71970de-908b-4cee-914b-88623acabb1b None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:17.372192 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71970de-908b-4cee-914b-88623acabb1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:17.373602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71970de-908b-4cee-914b-88623acabb1b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:17.394115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 505/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:41:17 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:19.125754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a19024-6486-451c-940b-fa57fc668c1d None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.126316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a19024-6486-451c-940b-fa57fc668c1d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.126316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a19024-6486-451c-940b-fa57fc668c1d None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.128276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 516/1021] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:19.133361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd91d2-b736-4d7b-856a-0602e52ca3cb None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.133770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd91d2-b736-4d7b-856a-0602e52ca3cb None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.133869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd91d2-b736-4d7b-856a-0602e52ca3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.151027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f4bd91d2-b736-4d7b-856a-0602e52ca3cb None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:19.152243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f4bd91d2-b736-4d7b-856a-0602e52ca3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:19.159814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d37ac-5e18-49ce-a8ed-7628bb797050 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.159985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d37ac-5e18-49ce-a8ed-7628bb797050 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.160276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d37ac-5e18-49ce-a8ed-7628bb797050 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.162066 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 517/1022] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:19.167596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8392bb-195d-4809-990b-4340e15ebbee None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.167953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8392bb-195d-4809-990b-4340e15ebbee None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.168321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8392bb-195d-4809-990b-4340e15ebbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.184914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ef8392bb-195d-4809-990b-4340e15ebbee None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:19.186098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ef8392bb-195d-4809-990b-4340e15ebbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:19.227814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 506/1023] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:19.252959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd91d2-b736-4d7b-856a-0602e52ca3cb None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.254242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 518/1024] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:19.275127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8392bb-195d-4809-990b-4340e15ebbee None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.352450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd91d2-b736-4d7b-856a-0602e52ca3cb None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:19.374322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8392bb-195d-4809-990b-4340e15ebbee None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:19.385488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:19.386501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.386830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.387194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.388266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:19.389704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:19.391623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 507/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:19.396979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.411440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:19.412247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.412459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.412731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.422877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:19.430240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 24 14:41:19.431591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 519/1026] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:19.437231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.495782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69f920-9b6b-4391-a0f6-7616cc48d236 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:19.529238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:19.529905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.530282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.530552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.531255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:19.531502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f2329-b07b-4846-97e4-4d26c8023b16 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:19.532711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:19.553870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 508/1027] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:41:19 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:41:19.565564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d54875-eca0-4f72-a815-52362d65629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:19.566316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d54875-eca0-4f72-a815-52362d65629f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.566600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d54875-eca0-4f72-a815-52362d65629f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.566873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d54875-eca0-4f72-a815-52362d65629f None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.567642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d54875-eca0-4f72-a815-52362d65629f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:19.567950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d54875-eca0-4f72-a815-52362d65629f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:19.569373 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d54875-eca0-4f72-a815-52362d65629f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:19.578961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 520/1028] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:19.584928 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.666368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b801-f679-407d-b592-02e535c0cf51 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.666702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b801-f679-407d-b592-02e535c0cf51 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.667050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3b801-f679-407d-b592-02e535c0cf51 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.669231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 521/1029] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:19.674768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c799-4d62-4feb-83e1-edba7030bada None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.675197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c799-4d62-4feb-83e1-edba7030bada None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.675706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c799-4d62-4feb-83e1-edba7030bada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.690220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f79d7b-54d9-4e70-ba2b-ba084ca1321d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:19.693712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8197c799-4d62-4feb-83e1-edba7030bada None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:19.695078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8197c799-4d62-4feb-83e1-edba7030bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:19.724831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:19.725645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.725927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.726234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.738188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:19.739649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:19.756574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:19.757798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 509/1030] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:19.763792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.763945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 522/1031] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:19.786791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c799-4d62-4feb-83e1-edba7030bada None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.871721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e81f34-1c99-4ce8-a135-7dd40ae54ae5 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:19.882047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c799-4d62-4feb-83e1-edba7030bada None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:19.906101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:19.906835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.907315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.907421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.908107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:19.908409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:19.909900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:19.914331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:19.915132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:19.915409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:19.915680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] PATH_INFO: `/v3/services/image` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:19.916331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:19.917742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:19.925821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 510/1032] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:19.926867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:19.928433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 24 14:41:19.929721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 523/1033] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/services/image => generated 86 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:19.935462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.024564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594780-1817-4ff0-9208-212abb21e661 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.032463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08799fc6-a9a6-48cd-bf18-b52027863bd7 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.057179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.058309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.058766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.059212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.064933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.065618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.065884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.066191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.066308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.066899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] RBAC: Adding query filter params (name=image) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:20.067211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.067676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.068560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.078315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 524/1034] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:20.079206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.081451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:41:20.082769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 511/1035] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:41:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:20.088297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.171727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291a065-ad24-42a3-8a31-f384f048ae7a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.181908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1c8c9-8078-4a75-92cf-f6d3f3afdee1 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.203030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.203807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.204312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.204728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.205352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:20.205653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.207044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.211621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 525/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:20.217197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.219485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.220136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.220418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.220691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.221525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:20.221831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.223300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.243558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 512/1037] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:20.249099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.315847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa481b-5442-4e5b-a3b3-2d98ef7f01c5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.341608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366143-0e68-4f7f-956a-0c84d4f4d063 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.348757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.349407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.349682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.349952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.350745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] RBAC: Adding query filter params (interface=public, service_id=4a5ebeb5c9fb4fa3a124f0b7bcee01f5, region_id=RegionOne) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:20.351047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.352411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.362189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 526/1038] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/endpoints?service_id=4a5ebeb5c9fb4fa3a124f0b7bcee01f5&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:20.362865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.378558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.379462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.379743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.380030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.441955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.443394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.457909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4e22f-fae7-4715-b843-0bf672927114 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.491110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.491801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.492054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.492327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.493006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.494434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.506252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 527/1039] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:41:20.544606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 513/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:41:20.550592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.658733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119f72-1ffe-4b47-aaaf-eec8e6814c95 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.694217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.694969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.695196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.695467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.706679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.708133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.725062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:20.726485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 528/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:20.732058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.829058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660223-394a-4a5f-8d68-cf8748030e88 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:20.865461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:20.865461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:20.865461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:20.865461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:20.865883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:20.865883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:20.868272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:20.879048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 514/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:20.884511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:20.990850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc1188-2308-448a-8370-a6914173c104 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:21.023342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:21.024180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:21.024444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:21.024762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:21.031254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:21.032706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:21.045507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:41:21.046865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 529/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:21.052630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:21.150638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e4b6-77bb-498d-97f5-0db0710511e0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:21.183305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbf2b5-4cbf-4c2e-8807-f61f8d48ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:21.184049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbf2b5-4cbf-4c2e-8807-f61f8d48ef7a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:21.184229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbf2b5-4cbf-4c2e-8807-f61f8d48ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:21.184515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbf2b5-4cbf-4c2e-8807-f61f8d48ef7a None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:21.185303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbf2b5-4cbf-4c2e-8807-f61f8d48ef7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:21.185605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbf2b5-4cbf-4c2e-8807-f61f8d48ef7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:21.187056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbf2b5-4cbf-4c2e-8807-f61f8d48ef7a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:21.199859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 515/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:41:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:21.206144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:21.305725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c2d3-78a0-486f-81e2-f119b3d6c711 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:21.339778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d1a4e-de1b-4921-9391-43c90067eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:21.340432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d1a4e-de1b-4921-9391-43c90067eb3a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:21.340711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d1a4e-de1b-4921-9391-43c90067eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:21.340985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d1a4e-de1b-4921-9391-43c90067eb3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:21.341809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d1a4e-de1b-4921-9391-43c90067eb3a None admin] RBAC: Adding query filter params (role.id=3628de61442e449ab5c1c490cbaeb16f, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=1cc15d4ea22b441ab70b958fba26a07f) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:21.342130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d1a4e-de1b-4921-9391-43c90067eb3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:21.343577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d1a4e-de1b-4921-9391-43c90067eb3a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:21.349108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 530/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:21 2022] GET /identity/v3/role_assignments?user.id=1cc15d4ea22b441ab70b958fba26a07f&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=3628de61442e449ab5c1c490cbaeb16f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:21.939804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b171-e4c7-475b-b06d-55fe403eb272 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:21.940139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b171-e4c7-475b-b06d-55fe403eb272 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:21.940328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401b171-e4c7-475b-b06d-55fe403eb272 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:21.942357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 516/1046] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:21.947610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5aa74-2f11-4e25-ac38-8a922369ca9f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:21.947884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5aa74-2f11-4e25-ac38-8a922369ca9f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:21.948181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5aa74-2f11-4e25-ac38-8a922369ca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:21.965762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-95b5aa74-2f11-4e25-ac38-8a922369ca9f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:21.966976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-95b5aa74-2f11-4e25-ac38-8a922369ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:22.032410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 531/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:22.055685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401b171-e4c7-475b-b06d-55fe403eb272 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:22.157006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401b171-e4c7-475b-b06d-55fe403eb272 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:22.190781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:22.191581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:22.191853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:22.192124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:22.202015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:22.209103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:41:22.210529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 517/1048] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:22.216331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5aa74-2f11-4e25-ac38-8a922369ca9f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:22.310304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5aa74-2f11-4e25-ac38-8a922369ca9f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:22.343822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:22.344518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:22.344807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:22.345054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:22.345803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:22.346113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:22.347537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:22.356067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 532/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:22.361825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:22.463718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c58249-e1de-43a4-b7d0-27c02d268883 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:22.496788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b113d-769e-43c3-b3b3-4f2109027cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:22.497660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b113d-769e-43c3-b3b3-4f2109027cba None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:22.497942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b113d-769e-43c3-b3b3-4f2109027cba None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:22.498249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b113d-769e-43c3-b3b3-4f2109027cba None admin] PATH_INFO: `/v3/users/3edc906521304554b48a47753ba61986` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:22.511572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b113d-769e-43c3-b3b3-4f2109027cba None admin] RBAC: Authorizing `identity:get_user(user_id=3edc906521304554b48a47753ba61986)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:22.513034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b113d-769e-43c3-b3b3-4f2109027cba None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:22.514919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 518/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:22 2022] GET /identity/v3/users/3edc906521304554b48a47753ba61986 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:22.520757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:22.617970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bc8f-592c-4b4f-b761-c014948dd269 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:22.651670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:22.652317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:22.652604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:22.652879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:22.715982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:22.717364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:22.770209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455331d-84bd-45c4-ad9a-cb266f617c5e None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:22.770476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455331d-84bd-45c4-ad9a-cb266f617c5e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:22.770948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455331d-84bd-45c4-ad9a-cb266f617c5e None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:22.772915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 519/1051] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:22.777848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0c02-2b0f-4fa3-b262-31de16a73858 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:22.778171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0c02-2b0f-4fa3-b262-31de16a73858 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:22.778451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0c02-2b0f-4fa3-b262-31de16a73858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:22.794501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-30cd0c02-2b0f-4fa3-b262-31de16a73858 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:22.795902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-30cd0c02-2b0f-4fa3-b262-31de16a73858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:22.811214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 533/1052] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:22 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:41:22.817416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:22.870220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 520/1053] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:22.892914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0c02-2b0f-4fa3-b262-31de16a73858 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:22.913359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46c86f-8082-4b85-a30d-9a93beed285c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:22.946597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:22.947475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:22.947755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:22.948029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:22.949230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] RBAC: Authorizing `identity:get_project(project_id=007f7104abc84f6590e8fc8ba260db29)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:22.950651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:22.952636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 534/1054] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:22 2022] GET /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:22.958876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:22.992693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0c02-2b0f-4fa3-b262-31de16a73858 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:23.023985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:23.025003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.025294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.025554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] PATH_INFO: `/v3/services/image` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.026239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:23.027592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:23.037997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 24 14:41:23.039348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 521/1055] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Mar 24 14:41:22 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:23.045476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:23.052599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16594-cb9b-47c2-88b3-fe518257b93c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:23.085255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:23.085912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.086296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.086574 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.087398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=007f7104abc84f6590e8fc8ba260db29, user.id=3edc906521304554b48a47753ba61986) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:23.087708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:23.089143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:23.094522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 535/1056] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:22 2022] GET /identity/v3/role_assignments?user.id=3edc906521304554b48a47753ba61986&scope.project.id=007f7104abc84f6590e8fc8ba260db29&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:23.147942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e91e3e-5a6e-4a65-9f6d-fdb32e7895d6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:23.185864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:23.186936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.187395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.187900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.188825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] RBAC: Adding query filter params (name=image) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:23.189332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:23.190962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:23.197415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 522/1057] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:23.204902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:23.311893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0f4e5-8f31-4a45-b8e0-607dcc3192c5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:23.345240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7715f23-26df-43a3-bff8-ebd8109daab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:23.345900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7715f23-26df-43a3-bff8-ebd8109daab0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.346224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7715f23-26df-43a3-bff8-ebd8109daab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.346499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7715f23-26df-43a3-bff8-ebd8109daab0 None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.347203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7715f23-26df-43a3-bff8-ebd8109daab0 None admin] RBAC: Adding query filter params (type=image) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:23.347502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7715f23-26df-43a3-bff8-ebd8109daab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:23.348861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7715f23-26df-43a3-bff8-ebd8109daab0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:23.353876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 536/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:23.359569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:23.459161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c820f6-e351-4666-8515-8a53ce71e535 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:23.493035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaa049-e4a2-42ed-8e92-e34f3bf1aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:23.493683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaa049-e4a2-42ed-8e92-e34f3bf1aa67 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.493965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaa049-e4a2-42ed-8e92-e34f3bf1aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.494273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaa049-e4a2-42ed-8e92-e34f3bf1aa67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.495002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaa049-e4a2-42ed-8e92-e34f3bf1aa67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:23.496385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaa049-e4a2-42ed-8e92-e34f3bf1aa67 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:23.519951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 523/1059] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:41:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:41:23.614252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56f736-73cf-40e0-87ca-7aed88a65b83 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.614620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56f736-73cf-40e0-87ca-7aed88a65b83 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.614802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56f736-73cf-40e0-87ca-7aed88a65b83 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.616805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 537/1060] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:23.622525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272c46-5c39-4a1c-8285-e65748dde3e7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.622824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272c46-5c39-4a1c-8285-e65748dde3e7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.623094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1272c46-5c39-4a1c-8285-e65748dde3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.641868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c1272c46-5c39-4a1c-8285-e65748dde3e7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:23.643149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c1272c46-5c39-4a1c-8285-e65748dde3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:23.720889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 524/1061] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:23.743475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56f736-73cf-40e0-87ca-7aed88a65b83 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:23.844456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56f736-73cf-40e0-87ca-7aed88a65b83 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:23.884051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:23.884051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:23.884051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:23.884051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:23.894971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:23.902446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 24 14:41:23.903900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 538/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Mar 24 14:41:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:23.909806 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1272c46-5c39-4a1c-8285-e65748dde3e7 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:24.008669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1272c46-5c39-4a1c-8285-e65748dde3e7 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:24.041872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:24.042561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:24.042843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:24.043118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:24.043869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:24.044177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:24.045554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:24.053675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 525/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Mar 24 14:41:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:24.059269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:24.158970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80d8ab-465d-4335-b62a-5e8fbb2fe243 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:24.192862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b216e-1804-4208-950d-26a478814df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:24.193667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b216e-1804-4208-950d-26a478814df5 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:24.193948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b216e-1804-4208-950d-26a478814df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:24.194258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b216e-1804-4208-950d-26a478814df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:24.207947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b216e-1804-4208-950d-26a478814df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:24.209538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b216e-1804-4208-950d-26a478814df5 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:24.226711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-882b216e-1804-4208-950d-26a478814df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:24.234167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 539/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:24.234294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:24.333047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a10cf-8781-444e-88bf-82abb7309a67 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:24.365435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:24.366146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:24.366533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:24.366858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:24.367588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:24.367929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:24.369307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:24.383116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 526/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:24.388781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b216e-1804-4208-950d-26a478814df5 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:24.488840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b216e-1804-4208-950d-26a478814df5 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:24.522374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:24.523252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:24.523541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:24.523861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:24.531683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:24.533131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:24.546474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:41:24.547991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 540/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:41:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:24.553823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:24.650065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051bc9-1676-4fce-b83b-c7772ddf292a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:24.684220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:24.684910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:24.685195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:24.685468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:24.686379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:24.686695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:24.688250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:24.707486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 527/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:41:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:24.713134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:24.813181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b1456-d1d1-415e-b94a-d57854054458 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:24.846973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:24.847760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:24.848044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:24.848314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:24.858697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:24.860214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:24.879648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:24.881054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 541/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:24.886804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:24.986247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905e96-5155-473b-b0e2-862f565965c2 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:25.021628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:25.022418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.022697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.022942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.023783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:25.024087 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:25.025473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:25.042538 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 528/1069] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:25.044187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:25.141082 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e8d24-894e-418a-afc6-43ae26ae550f None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:25.174223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:25.175015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.175293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.175554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.182203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:25.183653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:25.196836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:41:25.198005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 542/1070] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:25.204292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:25.305929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ec0c-9d0a-46d3-9912-45f11bb9fe73 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:25.339878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ba8d-2d13-4c39-924f-d13a0ab3f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:25.340540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ba8d-2d13-4c39-924f-d13a0ab3f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.340823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ba8d-2d13-4c39-924f-d13a0ab3f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.341092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ba8d-2d13-4c39-924f-d13a0ab3f3a4 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.341853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7ba8d-2d13-4c39-924f-d13a0ab3f3a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:25.342191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7ba8d-2d13-4c39-924f-d13a0ab3f3a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:25.343747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7ba8d-2d13-4c39-924f-d13a0ab3f3a4 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:25.356267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 529/1071] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:41:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:25.362434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:25.380436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e898-04b3-43f5-ac0a-0349d5d8e87a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.380759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e898-04b3-43f5-ac0a-0349d5d8e87a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.381002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14e898-04b3-43f5-ac0a-0349d5d8e87a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.382826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 530/1072] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:25.388774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e868-d540-429a-ab04-0dcea5f365d0 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.389066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e868-d540-429a-ab04-0dcea5f365d0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.389389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e868-d540-429a-ab04-0dcea5f365d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.405704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b343e868-d540-429a-ab04-0dcea5f365d0 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:25.406910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b343e868-d540-429a-ab04-0dcea5f365d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:25.461017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e32a-e2d7-4fa2-aa84-16941995c2d4 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:25.470363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 531/1073] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:25.493392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e868-d540-429a-ab04-0dcea5f365d0 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:25.499546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:25.500509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.500791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.501067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/1cc15d4ea22b441ab70b958fba26a07f/roles/3628de61442e449ab5c1c490cbaeb16f` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.503378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=1cc15d4ea22b441ab70b958fba26a07f, role_id=3628de61442e449ab5c1c490cbaeb16f)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:25.504865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:25.530125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 543/1074] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:41:25 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/1cc15d4ea22b441ab70b958fba26a07f/roles/3628de61442e449ab5c1c490cbaeb16f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:41:25.609870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e868-d540-429a-ab04-0dcea5f365d0 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:25.643857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:25.644662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.644945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.645218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.656563 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:25.663539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:41:25.665055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 532/1075] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:25.671272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:25.771507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac780-bc20-4d2e-9c78-056ec75db5d3 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:25.805631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5217ca2-9c7b-4dc1-8bf7-e5694bea8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:25.806334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217ca2-9c7b-4dc1-8bf7-e5694bea8d45 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.806622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217ca2-9c7b-4dc1-8bf7-e5694bea8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.806897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5217ca2-9c7b-4dc1-8bf7-e5694bea8d45 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.807635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5217ca2-9c7b-4dc1-8bf7-e5694bea8d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:25.807940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5217ca2-9c7b-4dc1-8bf7-e5694bea8d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:25.809316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5217ca2-9c7b-4dc1-8bf7-e5694bea8d45 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:25.817775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 544/1076] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:41:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:25.823691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:25.854460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746a22-c365-4079-b61b-e25abbdd1c4c None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.854792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746a22-c365-4079-b61b-e25abbdd1c4c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.855001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746a22-c365-4079-b61b-e25abbdd1c4c None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.856921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 545/1077] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:41:25.861794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4c690-518f-4570-99ca-d6fd0ec3d803 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.862062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4c690-518f-4570-99ca-d6fd0ec3d803 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.865469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4c690-518f-4570-99ca-d6fd0ec3d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.882024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a8e4c690-518f-4570-99ca-d6fd0ec3d803 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:25.883250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a8e4c690-518f-4570-99ca-d6fd0ec3d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:25.923844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf93d-427f-438f-8648-8e0b82cd915c None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:25.950508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 546/1078] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:25.957863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:25.958968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:25.959393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:25.959825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] PATH_INFO: `/v3/users/3edc906521304554b48a47753ba61986` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:25.961154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] RBAC: Authorizing `identity:get_user(user_id=3edc906521304554b48a47753ba61986)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:25.962752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:25.964789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 533/1079] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:25 2022] GET /identity/v3/users/3edc906521304554b48a47753ba61986 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:25.970413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4c690-518f-4570-99ca-d6fd0ec3d803 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:25.973533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:26.067378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4c690-518f-4570-99ca-d6fd0ec3d803 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:26.067652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64f1a-e2ce-48db-bd37-4ff5aaab759d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:26.100006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:26.100663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:26.100939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:26.101213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:26.101309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:26.102063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:26.102369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:26.102641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:26.103792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=007f7104abc84f6590e8fc8ba260db29)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:26.105213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:26.107098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 547/1080] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:25 2022] GET /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:26.112759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:26.166802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:26.168279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:26.206650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956824-3661-402c-b8b0-3658ed612aa8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:26.238765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:26.239664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:26.239938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:26.240207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29/users/3edc906521304554b48a47753ba61986/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:26.242149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] RBAC: Authorizing `identity:create_grant(project_id=007f7104abc84f6590e8fc8ba260db29, user_id=3edc906521304554b48a47753ba61986, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:26.243579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:26.256989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 548/1081] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:41:26 2022] PUT /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29/users/3edc906521304554b48a47753ba61986/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:41:26.270819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 534/1082] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:41:26.272491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:26.373931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfddfb6-4f8d-48fc-94df-01a44b70d2aa None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:26.410236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f0095-0d06-47b9-9787-55f5bee6d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:26.411036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f0095-0d06-47b9-9787-55f5bee6d2cd None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:26.411320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f0095-0d06-47b9-9787-55f5bee6d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:26.411597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f0095-0d06-47b9-9787-55f5bee6d2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:26.422967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f0095-0d06-47b9-9787-55f5bee6d2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:26.424443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f0095-0d06-47b9-9787-55f5bee6d2cd None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:26.442876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-363f0095-0d06-47b9-9787-55f5bee6d2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:26.444460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 549/1083] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:26.452137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:26.547064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37e488-ee9c-4297-b238-ce8b021d5cf3 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:26.581134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d365399-fb95-455a-83c1-c88ce0da5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:26.581799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d365399-fb95-455a-83c1-c88ce0da5a11 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:26.582077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d365399-fb95-455a-83c1-c88ce0da5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:26.582374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d365399-fb95-455a-83c1-c88ce0da5a11 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:26.583095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d365399-fb95-455a-83c1-c88ce0da5a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:26.583392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d365399-fb95-455a-83c1-c88ce0da5a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:26.584761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d365399-fb95-455a-83c1-c88ce0da5a11 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:26.602126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 535/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:27.808612 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9649-3379-4792-a23d-e748641f01c5 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:27.809194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9649-3379-4792-a23d-e748641f01c5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:27.809194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9649-3379-4792-a23d-e748641f01c5 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:27.810968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 550/1085] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:27.816328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dd324-16ef-433f-b806-d972d1faea54 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:27.816728 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dd324-16ef-433f-b806-d972d1faea54 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:27.816917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dd324-16ef-433f-b806-d972d1faea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:27.835084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-693dd324-16ef-433f-b806-d972d1faea54 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:27.836273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-693dd324-16ef-433f-b806-d972d1faea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:27.903513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 536/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:27.927001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb9649-3379-4792-a23d-e748641f01c5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.026432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb9649-3379-4792-a23d-e748641f01c5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.060188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.060923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.061203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.061478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.071501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:28.078882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 24 14:41:28.080577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 551/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Mar 24 14:41:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:28.086479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dd324-16ef-433f-b806-d972d1faea54 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.188187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dd324-16ef-433f-b806-d972d1faea54 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.224838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.225495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.225776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.226047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.226824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:28.227134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:28.228495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:28.236661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 537/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:28.242302 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.342959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8926863-0d69-4745-9203-299fc2dbe779 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.376077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25a881-b81a-4993-8c2d-25eb790fb48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.376875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a881-b81a-4993-8c2d-25eb790fb48d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.377157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a881-b81a-4993-8c2d-25eb790fb48d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.377436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a881-b81a-4993-8c2d-25eb790fb48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.387727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25a881-b81a-4993-8c2d-25eb790fb48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:28.389177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25a881-b81a-4993-8c2d-25eb790fb48d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:28.404963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ca25a881-b81a-4993-8c2d-25eb790fb48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:28.406174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 552/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:28.412128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.512309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5c79d-42e4-4cec-a5a0-446a86e48cf6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.520953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f632-7ebf-4f94-aa1c-b145bd4ffb60 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.521321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f632-7ebf-4f94-aa1c-b145bd4ffb60 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.521608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f632-7ebf-4f94-aa1c-b145bd4ffb60 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.523428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 553/1090] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:28.528468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4871a5-f0a4-444c-a993-9f8e0ebc14dd None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.528757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4871a5-f0a4-444c-a993-9f8e0ebc14dd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.529059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4871a5-f0a4-444c-a993-9f8e0ebc14dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.543941 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.544601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.544882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.545157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.545881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:28.546215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:28.547079 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3b4871a5-f0a4-444c-a993-9f8e0ebc14dd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:28.547631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:28.548246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3b4871a5-f0a4-444c-a993-9f8e0ebc14dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:28.559553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 538/1091] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:28.565095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.613894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 554/1092] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:28.636821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4871a5-f0a4-444c-a993-9f8e0ebc14dd None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.662324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525afcdc-8e4b-4904-a74b-dd443f01264b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.696752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.697539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.697814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.698094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.705447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:28.706910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:28.720235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 24 14:41:28.721389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 539/1093] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:28.727185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.731522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4871a5-f0a4-444c-a993-9f8e0ebc14dd None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.763336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.764246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.764593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.764874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.774786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:28.781582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:41:28.782771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 555/1094] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:28.788605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.821494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ffcbc-4ea1-4525-ad6c-4ecba0a69f29 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.853998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.854712 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.855054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.855326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.856151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:28.856454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:28.857921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:28.874755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 540/1095] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:28.880237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.883213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fddf1c-52dd-489b-a011-c390c2dbef56 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:28.914792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:28.915454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:28.915725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:28.915991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:28.916722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:28.917026 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:28.918424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:28.927485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 556/1096] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:28.933165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:28.973100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a9e7e-3de4-4f46-8632-c1e7e5c48862 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.006975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.007628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.007907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.008172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.023993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4376a-2068-4598-b24a-24f86a26a726 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.057098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.057944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.058246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.058490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] PATH_INFO: `/v3/users/3edc906521304554b48a47753ba61986` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.059711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=3edc906521304554b48a47753ba61986)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.061130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.062837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 557/1097] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/users/3edc906521304554b48a47753ba61986 => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:29.068681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.072191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.073642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.163604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a655c8-dc7e-44ad-861f-c718739beaf2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.167759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 541/1098] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:41:29.173522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.197176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.197819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.198122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.198401 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.263486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.264941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.267718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac84cc-2029-45eb-9303-7eded390936b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.301303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.302113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.302415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.302690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.313053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.314607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.332125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:41:29.333283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 542/1099] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:29.338940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.366118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 558/1100] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:41:29.372045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.434238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298881d9-7870-4e4d-b3e6-311764d9e631 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.467518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.468165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.468446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.468728 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.469041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad9ede-dea5-4cbf-8b94-ffba445b0cf0 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.469442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:29.469746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.471138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.481863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 543/1101] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:29.487408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.502214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.503077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.503361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.503635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.504822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] RBAC: Authorizing `identity:get_project(project_id=007f7104abc84f6590e8fc8ba260db29)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.506296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.507992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 559/1102] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:29.513811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.580710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e6f00-a7da-44f5-bcb6-cb0652ffde4b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.608346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7050b-015b-45ac-8f8a-090862fe04cf None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.612216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.613009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.613287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.613554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.620144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.621661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.634822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:41:29.636041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 544/1103] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:41:29.639956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.640645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.640947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.641222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.641922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.642022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=007f7104abc84f6590e8fc8ba260db29, user.id=3edc906521304554b48a47753ba61986) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:29.642374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.643809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.666116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 560/1104] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/role_assignments?user.id=3edc906521304554b48a47753ba61986&scope.project.id=007f7104abc84f6590e8fc8ba260db29&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:41:29.743575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b2745-c9c2-4754-b60a-12efbd7dd641 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:29.780248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b843e4-fda7-4be5-ab59-7c236471ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:29.780912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b843e4-fda7-4be5-ab59-7c236471ff61 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:29.781200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b843e4-fda7-4be5-ab59-7c236471ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:29.781523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b843e4-fda7-4be5-ab59-7c236471ff61 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:29.782307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b843e4-fda7-4be5-ab59-7c236471ff61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:29.782611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b843e4-fda7-4be5-ab59-7c236471ff61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:29.784064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b843e4-fda7-4be5-ab59-7c236471ff61 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:29.796577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 545/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:29.803116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:29.907122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3beb4-5676-4550-a26b-d3c3f4b7e35c None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:30.073132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfee4e9-a644-4177-b354-48b2094509b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:30.073788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee4e9-a644-4177-b354-48b2094509b7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:30.074061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee4e9-a644-4177-b354-48b2094509b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:30.074368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfee4e9-a644-4177-b354-48b2094509b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:30.075178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfee4e9-a644-4177-b354-48b2094509b7 None admin] RBAC: Adding query filter params (role.id=3628de61442e449ab5c1c490cbaeb16f, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=1cc15d4ea22b441ab70b958fba26a07f) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:30.075479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfee4e9-a644-4177-b354-48b2094509b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:30.076899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfee4e9-a644-4177-b354-48b2094509b7 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:30.083133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 561/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:29 2022] GET /identity/v3/role_assignments?user.id=1cc15d4ea22b441ab70b958fba26a07f&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=3628de61442e449ab5c1c490cbaeb16f => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:31.949503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f9df5-ef88-4d6d-b084-c27231427383 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:31.950407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f9df5-ef88-4d6d-b084-c27231427383 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:31.950407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f9df5-ef88-4d6d-b084-c27231427383 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:31.953272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 546/1107] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:31.961424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a7c92-90d7-487a-b202-9cb8fbb6b556 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:31.961879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a7c92-90d7-487a-b202-9cb8fbb6b556 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:31.961975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a7c92-90d7-487a-b202-9cb8fbb6b556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:31.980281 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2e7a7c92-90d7-487a-b202-9cb8fbb6b556 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:31.981437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2e7a7c92-90d7-487a-b202-9cb8fbb6b556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:32.047832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 562/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:32.078421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f9df5-ef88-4d6d-b084-c27231427383 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:32.179326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f9df5-ef88-4d6d-b084-c27231427383 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:32.214566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb936f-7d51-4fb3-8ae4-d316743e79b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:32.215661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb936f-7d51-4fb3-8ae4-d316743e79b4 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:32.216030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb936f-7d51-4fb3-8ae4-d316743e79b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:32.216391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb936f-7d51-4fb3-8ae4-d316743e79b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:32.218490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb936f-7d51-4fb3-8ae4-d316743e79b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:32.220722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb936f-7d51-4fb3-8ae4-d316743e79b4 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:32.223229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 547/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:32.228964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a7c92-90d7-487a-b202-9cb8fbb6b556 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:32.327776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a7c92-90d7-487a-b202-9cb8fbb6b556 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:32.360968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a672b4-4b9a-4edb-aaec-36fc706a99da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:32.361620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a672b4-4b9a-4edb-aaec-36fc706a99da None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:32.361898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a672b4-4b9a-4edb-aaec-36fc706a99da None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:32.362206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a672b4-4b9a-4edb-aaec-36fc706a99da None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:32.362902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a672b4-4b9a-4edb-aaec-36fc706a99da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:32.364324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a672b4-4b9a-4edb-aaec-36fc706a99da None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:32.386148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 563/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:41:32 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:34.685948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899f84-d620-48a6-bf02-d05928d27b4b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:34.686564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899f84-d620-48a6-bf02-d05928d27b4b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:34.686687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899f84-d620-48a6-bf02-d05928d27b4b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:34.688483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 548/1111] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:34.694969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eeea2-9e1d-4765-a03c-6f6282a86e85 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:34.695675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eeea2-9e1d-4765-a03c-6f6282a86e85 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:34.695818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1eeea2-9e1d-4765-a03c-6f6282a86e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:34.717684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ee1eeea2-9e1d-4765-a03c-6f6282a86e85 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:34.718899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ee1eeea2-9e1d-4765-a03c-6f6282a86e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:34.800987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 564/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:34.829656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd899f84-d620-48a6-bf02-d05928d27b4b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:34.949768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd899f84-d620-48a6-bf02-d05928d27b4b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:34.982988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:34.983839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:34.984160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:34.984428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] PATH_INFO: `/v3/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:34.985931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] RBAC: Authorizing `identity:get_role(role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:34.987314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:34.988676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 549/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:34 2022] GET /identity/v3/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:34.994793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eeea2-9e1d-4765-a03c-6f6282a86e85 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:35.091150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1eeea2-9e1d-4765-a03c-6f6282a86e85 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:35.125851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:35.126740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:35.127017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:35.127291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] PATH_INFO: `/v3/users/85cedda3865c4039986e0290f2fddfde` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:35.141899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] RBAC: Authorizing `identity:get_user(user_id=85cedda3865c4039986e0290f2fddfde)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:35.143359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:35.144979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 565/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:34 2022] GET /identity/v3/users/85cedda3865c4039986e0290f2fddfde => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:35.151494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:35.259787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0962836-477a-4da9-97dd-4aa961a7e133 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:35.292867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:35.293494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:35.293768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:35.294035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:35.359104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:35.360547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:35.467030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 550/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:41:35.475655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:35.573763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631371e1-1384-415c-83e8-f65dd84bab94 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:35.607841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe60af-39fb-490b-9617-ce729dbd5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:35.608686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe60af-39fb-490b-9617-ce729dbd5830 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:35.608964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe60af-39fb-490b-9617-ce729dbd5830 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:35.609257 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe60af-39fb-490b-9617-ce729dbd5830 None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:35.610569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe60af-39fb-490b-9617-ce729dbd5830 None admin] RBAC: Authorizing `identity:get_project(project_id=007f7104abc84f6590e8fc8ba260db29)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:35.611995 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe60af-39fb-490b-9617-ce729dbd5830 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:35.613665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 566/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:35 2022] GET /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:35.623467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:35.721437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793793a-b2fd-4a61-a8c6-274d19e4b0b8 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:35.754964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e1ff4-de8e-4531-8824-c50b4c453069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:35.755589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1ff4-de8e-4531-8824-c50b4c453069 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:35.755866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1ff4-de8e-4531-8824-c50b4c453069 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:35.756139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e1ff4-de8e-4531-8824-c50b4c453069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:35.756951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e1ff4-de8e-4531-8824-c50b4c453069 None admin] RBAC: Adding query filter params (role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=007f7104abc84f6590e8fc8ba260db29, user.id=85cedda3865c4039986e0290f2fddfde) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:35.757259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e1ff4-de8e-4531-8824-c50b4c453069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:35.758708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e1ff4-de8e-4531-8824-c50b4c453069 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:35.764094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 551/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:35 2022] GET /identity/v3/role_assignments?user.id=85cedda3865c4039986e0290f2fddfde&scope.project.id=007f7104abc84f6590e8fc8ba260db29&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:37.972283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9f6e1-9a42-45dd-a5f2-dd2953eddf5c None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:37.972832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9f6e1-9a42-45dd-a5f2-dd2953eddf5c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:37.972832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9f6e1-9a42-45dd-a5f2-dd2953eddf5c None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:37.974662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 567/1118] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:37.980977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a825608-45d5-4364-9186-f511cfbcb997 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:37.981690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a825608-45d5-4364-9186-f511cfbcb997 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:37.981836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a825608-45d5-4364-9186-f511cfbcb997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:38.006874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2a825608-45d5-4364-9186-f511cfbcb997 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:38.008056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2a825608-45d5-4364-9186-f511cfbcb997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:38.077915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 552/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:38.106848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9f6e1-9a42-45dd-a5f2-dd2953eddf5c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:38.209750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9f6e1-9a42-45dd-a5f2-dd2953eddf5c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:38.243734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:38.244542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:38.244821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:38.245092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] PATH_INFO: `/v3/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:38.246610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] RBAC: Authorizing `identity:get_role(role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:38.247961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:38.249289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 568/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:38 2022] GET /identity/v3/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:38.255840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a825608-45d5-4364-9186-f511cfbcb997 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:38.359744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a825608-45d5-4364-9186-f511cfbcb997 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:38.399134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:38.400406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:38.400767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:38.401152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] PATH_INFO: `/v3/users/85cedda3865c4039986e0290f2fddfde` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:38.403201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] RBAC: Authorizing `identity:get_user(user_id=85cedda3865c4039986e0290f2fddfde)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:38.405420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:38.407888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 553/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:38 2022] GET /identity/v3/users/85cedda3865c4039986e0290f2fddfde => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:38.413872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:38.514693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14131d-8762-4a33-b3d9-0a5a82c84529 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:38.548678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cc8fd-74d6-4ba0-83de-370b0bdd0bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:38.549546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc8fd-74d6-4ba0-83de-370b0bdd0bcc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:38.549829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc8fd-74d6-4ba0-83de-370b0bdd0bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:38.550121 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cc8fd-74d6-4ba0-83de-370b0bdd0bcc None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:38.551336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cc8fd-74d6-4ba0-83de-370b0bdd0bcc None admin] RBAC: Authorizing `identity:get_project(project_id=007f7104abc84f6590e8fc8ba260db29)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:38.552771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cc8fd-74d6-4ba0-83de-370b0bdd0bcc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:38.558125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 569/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:38 2022] GET /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:38.560624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:38.655681 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797877-6d70-4b0c-8439-7ca271d511c6 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:38.689782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b318a8c-bb3e-4c31-b550-9b7edd7f4f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:38.690802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318a8c-bb3e-4c31-b550-9b7edd7f4f7a None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:38.691082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318a8c-bb3e-4c31-b550-9b7edd7f4f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:38.691361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318a8c-bb3e-4c31-b550-9b7edd7f4f7a None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29/users/85cedda3865c4039986e0290f2fddfde/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:38.693786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b318a8c-bb3e-4c31-b550-9b7edd7f4f7a None admin] RBAC: Authorizing `identity:create_grant(project_id=007f7104abc84f6590e8fc8ba260db29, user_id=85cedda3865c4039986e0290f2fddfde, role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:38.695265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b318a8c-bb3e-4c31-b550-9b7edd7f4f7a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:38.709287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 554/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:41:38 2022] PUT /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29/users/85cedda3865c4039986e0290f2fddfde/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:41:40.951835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81bbc-c86a-4e64-a790-1fc4268164fd None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:40.952349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81bbc-c86a-4e64-a790-1fc4268164fd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:40.952440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81bbc-c86a-4e64-a790-1fc4268164fd None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:40.955677 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 570/1124] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:40.963490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486843-3f02-420c-bbc6-8e330d804427 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:40.963931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486843-3f02-420c-bbc6-8e330d804427 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:40.964018 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486843-3f02-420c-bbc6-8e330d804427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:40.981818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c7486843-3f02-420c-bbc6-8e330d804427 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:40.983009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c7486843-3f02-420c-bbc6-8e330d804427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:41.049333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 555/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:41:41.077957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81bbc-c86a-4e64-a790-1fc4268164fd None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:41.187037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81bbc-c86a-4e64-a790-1fc4268164fd None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:41.222217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:41.223051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:41.223354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:41.223617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] PATH_INFO: `/v3/roles/3da296d7ec3b484bbc1bde743e5689c5` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:41.225193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] RBAC: Authorizing `identity:get_role(role_id=3da296d7ec3b484bbc1bde743e5689c5)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:41.226593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:41.227950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 571/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:41 2022] GET /identity/v3/roles/3da296d7ec3b484bbc1bde743e5689c5 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:41.234688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486843-3f02-420c-bbc6-8e330d804427 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:41.345625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486843-3f02-420c-bbc6-8e330d804427 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:41.378369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:41.379215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:41.379490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:41.379759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] PATH_INFO: `/v3/users/85cedda3865c4039986e0290f2fddfde` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:41.381051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] RBAC: Authorizing `identity:get_user(user_id=85cedda3865c4039986e0290f2fddfde)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:41.382511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:41.384107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 556/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:41 2022] GET /identity/v3/users/85cedda3865c4039986e0290f2fddfde => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:41.393234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:41.510910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d7d30-4e44-44c4-9c94-09aab74d16a6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:41.543655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:41.544278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:41.544551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:41.544821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:41.609076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:41.610534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:41.708199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 572/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:41:41.714330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:41.812783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c488-cd51-45ef-becf-1e1972c9584a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:41.845602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947a86-7836-417b-98a8-ef405e1535d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:41.846460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947a86-7836-417b-98a8-ef405e1535d3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:41.846738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947a86-7836-417b-98a8-ef405e1535d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:41.847009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947a86-7836-417b-98a8-ef405e1535d3 None admin] PATH_INFO: `/v3/projects/007f7104abc84f6590e8fc8ba260db29` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:41.848227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947a86-7836-417b-98a8-ef405e1535d3 None admin] RBAC: Authorizing `identity:get_project(project_id=007f7104abc84f6590e8fc8ba260db29)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:41.849632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947a86-7836-417b-98a8-ef405e1535d3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:41.851291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 557/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:41 2022] GET /identity/v3/projects/007f7104abc84f6590e8fc8ba260db29 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:41.857771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:41.958811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ef46-c2ad-4409-959e-797e53dc021d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:41.993120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8c6be-4125-442b-888d-ee1020e5180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:41.993752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8c6be-4125-442b-888d-ee1020e5180c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:41.994034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8c6be-4125-442b-888d-ee1020e5180c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:41.994337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8c6be-4125-442b-888d-ee1020e5180c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:41.995152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8c6be-4125-442b-888d-ee1020e5180c None admin] RBAC: Adding query filter params (role.id=3da296d7ec3b484bbc1bde743e5689c5, scope.project.id=007f7104abc84f6590e8fc8ba260db29, user.id=85cedda3865c4039986e0290f2fddfde) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:41.995461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8c6be-4125-442b-888d-ee1020e5180c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:41.996873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8c6be-4125-442b-888d-ee1020e5180c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:42.002686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 573/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:41 2022] GET /identity/v3/role_assignments?user.id=85cedda3865c4039986e0290f2fddfde&scope.project.id=007f7104abc84f6590e8fc8ba260db29&role.id=3da296d7ec3b484bbc1bde743e5689c5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:44.250687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecb69-ce57-4404-81c1-8a4b0508bd3b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:44.251238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecb69-ce57-4404-81c1-8a4b0508bd3b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:44.251238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecb69-ce57-4404-81c1-8a4b0508bd3b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:44.252900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 558/1131] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:44.259208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f9d6-0d9d-42f2-8a2b-a07a50a97728 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:44.259917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f9d6-0d9d-42f2-8a2b-a07a50a97728 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:44.260061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7f9d6-0d9d-42f2-8a2b-a07a50a97728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:44.279185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-31d7f9d6-0d9d-42f2-8a2b-a07a50a97728 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:44.280354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-31d7f9d6-0d9d-42f2-8a2b-a07a50a97728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:44.346343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 574/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:44.369519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aecb69-ce57-4404-81c1-8a4b0508bd3b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:44.476768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aecb69-ce57-4404-81c1-8a4b0508bd3b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:44.510225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd2a5e-d333-471a-89ae-16a60f6d5236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:44.510934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2a5e-d333-471a-89ae-16a60f6d5236 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:44.511216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2a5e-d333-471a-89ae-16a60f6d5236 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:44.511488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd2a5e-d333-471a-89ae-16a60f6d5236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:44.512710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd2a5e-d333-471a-89ae-16a60f6d5236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:44.514132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd2a5e-d333-471a-89ae-16a60f6d5236 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:44.515775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 559/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:44.522062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7f9d6-0d9d-42f2-8a2b-a07a50a97728 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:44.627888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7f9d6-0d9d-42f2-8a2b-a07a50a97728 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:44.661393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a205bea-2c9f-42ae-85f9-ae8bdde0857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:44.662030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205bea-2c9f-42ae-85f9-ae8bdde0857c None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:44.662336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205bea-2c9f-42ae-85f9-ae8bdde0857c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:44.662604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a205bea-2c9f-42ae-85f9-ae8bdde0857c None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:44.663299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a205bea-2c9f-42ae-85f9-ae8bdde0857c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:44.664712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a205bea-2c9f-42ae-85f9-ae8bdde0857c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:44.699190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 575/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:41:44 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:46.986016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b414e7-1072-4590-a5e6-57d272b9d4cc None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:46.986546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b414e7-1072-4590-a5e6-57d272b9d4cc None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:46.986546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b414e7-1072-4590-a5e6-57d272b9d4cc None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:46.988356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 560/1135] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:46.994821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5e0d-95e7-4ae8-801c-897a3b5694c4 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:46.995567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5e0d-95e7-4ae8-801c-897a3b5694c4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:46.995712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5e0d-95e7-4ae8-801c-897a3b5694c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:47.015729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-cd5f5e0d-95e7-4ae8-801c-897a3b5694c4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:47.016889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cd5f5e0d-95e7-4ae8-801c-897a3b5694c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:47.096627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 576/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:47.123267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b414e7-1072-4590-a5e6-57d272b9d4cc None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:47.244077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b414e7-1072-4590-a5e6-57d272b9d4cc None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:47.277112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c3272-a71f-455f-98e8-dc2774afe9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:47.277898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3272-a71f-455f-98e8-dc2774afe9fb None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:47.278207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3272-a71f-455f-98e8-dc2774afe9fb None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:47.278491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3272-a71f-455f-98e8-dc2774afe9fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:47.279717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c3272-a71f-455f-98e8-dc2774afe9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:47.281171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c3272-a71f-455f-98e8-dc2774afe9fb None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:47.282812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 561/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:41:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:47.288800 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5e0d-95e7-4ae8-801c-897a3b5694c4 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:47.402968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5e0d-95e7-4ae8-801c-897a3b5694c4 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:47.438323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5055f55-1ee2-45a3-9553-51cd9df84379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:47.438971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5055f55-1ee2-45a3-9553-51cd9df84379 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:47.439250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5055f55-1ee2-45a3-9553-51cd9df84379 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:47.439524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5055f55-1ee2-45a3-9553-51cd9df84379 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:47.440229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5055f55-1ee2-45a3-9553-51cd9df84379 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:47.441651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5055f55-1ee2-45a3-9553-51cd9df84379 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:47.465757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 577/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:41:47 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:41:49.784869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067960b-e9cc-4900-ac3d-4213010de527 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:49.785764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067960b-e9cc-4900-ac3d-4213010de527 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:49.785764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067960b-e9cc-4900-ac3d-4213010de527 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:49.788623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 562/1139] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:49.794215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5945c-33c6-45f2-b756-453593fedb88 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:49.794652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5945c-33c6-45f2-b756-453593fedb88 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:49.794749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5945c-33c6-45f2-b756-453593fedb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:49.813195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f2d5945c-33c6-45f2-b756-453593fedb88 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:49.814395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f2d5945c-33c6-45f2-b756-453593fedb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:49.883282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 578/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:49.907837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067960b-e9cc-4900-ac3d-4213010de527 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:50.020150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067960b-e9cc-4900-ac3d-4213010de527 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:50.054237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:50.054956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:50.055241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:50.055519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:50.067459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:50.074262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:41:50.075428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 563/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:50.082719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5945c-33c6-45f2-b756-453593fedb88 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:50.195019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5945c-33c6-45f2-b756-453593fedb88 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:50.231308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:50.231969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:50.232251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:50.232520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:50.233267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:50.233579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:50.235040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:50.245251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 579/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:50.251281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:50.348211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208e765-e0ab-4f59-91fd-4f6f8a48e692 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:50.382104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:50.382956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:50.383235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:50.383511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] PATH_INFO: `/v3/users/a88b1da9ec5844ffa8d7cdaf5c7438ce` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:50.396812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] RBAC: Authorizing `identity:get_user(user_id=a88b1da9ec5844ffa8d7cdaf5c7438ce)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:50.398301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:50.399896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 564/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:50 2022] GET /identity/v3/users/a88b1da9ec5844ffa8d7cdaf5c7438ce => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:50.406274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:50.523821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a6ed6-df48-4389-a843-4f64dc4917da None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:50.556545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:50.557167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:50.557442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:50.557710 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:50.622662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:50.624017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:50.718246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 580/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:41:50.727465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:50.837349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d9c5-4cc3-4c58-b992-f2ae249e40b0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:50.870702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418c2a-d985-42a5-9ffe-83b3ac3a1609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:50.871544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418c2a-d985-42a5-9ffe-83b3ac3a1609 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:50.871821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418c2a-d985-42a5-9ffe-83b3ac3a1609 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:50.872084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418c2a-d985-42a5-9ffe-83b3ac3a1609 None admin] PATH_INFO: `/v3/projects/65f4db5434134a4282bdfb93cbf76fe2` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:50.873435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418c2a-d985-42a5-9ffe-83b3ac3a1609 None admin] RBAC: Authorizing `identity:get_project(project_id=65f4db5434134a4282bdfb93cbf76fe2)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:50.874882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418c2a-d985-42a5-9ffe-83b3ac3a1609 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:50.876547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 565/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:50 2022] GET /identity/v3/projects/65f4db5434134a4282bdfb93cbf76fe2 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:50.883320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:50.996551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc6d60-d074-46d2-be45-65affcee7964 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:51.030686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5eeae-2925-4b74-99db-53c1e51765f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:51.031333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5eeae-2925-4b74-99db-53c1e51765f8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:51.031609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5eeae-2925-4b74-99db-53c1e51765f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:51.031886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5eeae-2925-4b74-99db-53c1e51765f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:51.032703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5eeae-2925-4b74-99db-53c1e51765f8 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=65f4db5434134a4282bdfb93cbf76fe2, user.id=a88b1da9ec5844ffa8d7cdaf5c7438ce) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:51.033015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5eeae-2925-4b74-99db-53c1e51765f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:51.034468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5eeae-2925-4b74-99db-53c1e51765f8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:51.039905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 581/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:50 2022] GET /identity/v3/role_assignments?user.id=a88b1da9ec5844ffa8d7cdaf5c7438ce&scope.project.id=65f4db5434134a4282bdfb93cbf76fe2&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:53.266394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d198c-7fee-43c6-9f87-faaf2d357927 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:53.266918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d198c-7fee-43c6-9f87-faaf2d357927 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:53.266918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d198c-7fee-43c6-9f87-faaf2d357927 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:53.268602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 566/1147] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:53.275061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5332-a849-40f1-8ae6-0595eeb93729 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:53.275739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5332-a849-40f1-8ae6-0595eeb93729 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:53.275927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5332-a849-40f1-8ae6-0595eeb93729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:53.301100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-fc0d5332-a849-40f1-8ae6-0595eeb93729 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:53.302304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fc0d5332-a849-40f1-8ae6-0595eeb93729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:53.369372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 582/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:53.392666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d198c-7fee-43c6-9f87-faaf2d357927 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:53.506685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d198c-7fee-43c6-9f87-faaf2d357927 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:53.539541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:53.540256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:53.540537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:53.540808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:53.550551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:53.557362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:41:53.558554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 567/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:53.565532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5332-a849-40f1-8ae6-0595eeb93729 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:53.686952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5332-a849-40f1-8ae6-0595eeb93729 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:53.721648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:53.722326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:53.722608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:53.722862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:53.723599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:53.723902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:53.725266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:53.733053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 583/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:53.739036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:53.846390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e0630-82f7-4d59-be54-e432eb7f9bee None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:53.880556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:53.881417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:53.881699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:53.881952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] PATH_INFO: `/v3/users/a88b1da9ec5844ffa8d7cdaf5c7438ce` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:53.883187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] RBAC: Authorizing `identity:get_user(user_id=a88b1da9ec5844ffa8d7cdaf5c7438ce)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:53.884617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:53.886268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 568/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:53 2022] GET /identity/v3/users/a88b1da9ec5844ffa8d7cdaf5c7438ce => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:53.892099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:53.997749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae50e-a015-489d-9592-49e4d8a14127 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:54.038328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1d3c6-b18d-4879-afa3-203542f5dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:54.039166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d3c6-b18d-4879-afa3-203542f5dc92 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:54.039444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d3c6-b18d-4879-afa3-203542f5dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:54.039707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1d3c6-b18d-4879-afa3-203542f5dc92 None admin] PATH_INFO: `/v3/projects/65f4db5434134a4282bdfb93cbf76fe2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:54.040912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1d3c6-b18d-4879-afa3-203542f5dc92 None admin] RBAC: Authorizing `identity:get_project(project_id=65f4db5434134a4282bdfb93cbf76fe2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:54.042364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1d3c6-b18d-4879-afa3-203542f5dc92 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:54.044040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 584/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:53 2022] GET /identity/v3/projects/65f4db5434134a4282bdfb93cbf76fe2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:54.052102 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:54.161273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a8dc2-3c4f-4714-9007-cf98c2b96637 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:54.194538 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c455d9-552f-48b8-b49e-c9f55687454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:54.195434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c455d9-552f-48b8-b49e-c9f55687454a None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:54.195713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c455d9-552f-48b8-b49e-c9f55687454a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:54.195993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c455d9-552f-48b8-b49e-c9f55687454a None admin] PATH_INFO: `/v3/projects/65f4db5434134a4282bdfb93cbf76fe2/users/a88b1da9ec5844ffa8d7cdaf5c7438ce/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:54.198238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c455d9-552f-48b8-b49e-c9f55687454a None admin] RBAC: Authorizing `identity:create_grant(project_id=65f4db5434134a4282bdfb93cbf76fe2, user_id=a88b1da9ec5844ffa8d7cdaf5c7438ce, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:54.199655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c455d9-552f-48b8-b49e-c9f55687454a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:54.221781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 569/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:41:54 2022] PUT /identity/v3/projects/65f4db5434134a4282bdfb93cbf76fe2/users/a88b1da9ec5844ffa8d7cdaf5c7438ce/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:41:56.488414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eb6f9-0ca8-4644-afc6-189a3c7f7357 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:56.489087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eb6f9-0ca8-4644-afc6-189a3c7f7357 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:56.489087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eb6f9-0ca8-4644-afc6-189a3c7f7357 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:56.490774 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 585/1154] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:41:56.497060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f099-e1e2-4a72-9a9b-01528594c72e None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:56.497531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f099-e1e2-4a72-9a9b-01528594c72e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:56.497622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1f099-e1e2-4a72-9a9b-01528594c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:56.521792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-57c1f099-e1e2-4a72-9a9b-01528594c72e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:41:56.523079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-57c1f099-e1e2-4a72-9a9b-01528594c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:41:56.593103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 570/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:41:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:41:56.629616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eb6f9-0ca8-4644-afc6-189a3c7f7357 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:56.738986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eb6f9-0ca8-4644-afc6-189a3c7f7357 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:56.771635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:56.772407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:56.772687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:56.772956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:56.783911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:41:56.790608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:41:56.791751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 586/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:41:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:41:56.798183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f099-e1e2-4a72-9a9b-01528594c72e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:56.910271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1f099-e1e2-4a72-9a9b-01528594c72e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:56.953594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:56.954279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:56.954885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:56.955161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:56.955910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:56.956211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:56.957592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:56.965558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 571/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:41:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:56.971492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:57.083298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80256c7-c4d8-4987-a17a-f45e8411caed None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:57.115910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:57.116757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:57.117037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:57.117314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] PATH_INFO: `/v3/users/a88b1da9ec5844ffa8d7cdaf5c7438ce` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:57.118563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] RBAC: Authorizing `identity:get_user(user_id=a88b1da9ec5844ffa8d7cdaf5c7438ce)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:57.119993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:57.121594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 587/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:41:56 2022] GET /identity/v3/users/a88b1da9ec5844ffa8d7cdaf5c7438ce => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:57.130010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:57.241040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0d3ac-23e6-4361-b40e-fb84f22d5235 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:57.276501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:57.277130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:57.277405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:57.277676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:57.349272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:57.350682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:57.444690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 572/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:41:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:41:57.451286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:57.556400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9bc18-8461-4633-be94-1d13784088cf None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:57.601656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3e287-66c6-4572-9bb3-8bb3da2a2cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:57.602507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3e287-66c6-4572-9bb3-8bb3da2a2cea None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:57.602761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3e287-66c6-4572-9bb3-8bb3da2a2cea None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:57.603034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3e287-66c6-4572-9bb3-8bb3da2a2cea None admin] PATH_INFO: `/v3/projects/65f4db5434134a4282bdfb93cbf76fe2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:57.604259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3e287-66c6-4572-9bb3-8bb3da2a2cea None admin] RBAC: Authorizing `identity:get_project(project_id=65f4db5434134a4282bdfb93cbf76fe2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:57.605692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3e287-66c6-4572-9bb3-8bb3da2a2cea None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:57.607417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 588/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:41:57 2022] GET /identity/v3/projects/65f4db5434134a4282bdfb93cbf76fe2 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:41:57.613622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:41:57.708929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0d80b-2a82-461f-a77f-f0a6c2110410 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:41:57.745051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6bec2-83d5-4d6a-9563-57e7c67743a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:41:57.745684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6bec2-83d5-4d6a-9563-57e7c67743a1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:41:57.745960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6bec2-83d5-4d6a-9563-57e7c67743a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:41:57.746264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6bec2-83d5-4d6a-9563-57e7c67743a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:41:57.747082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6bec2-83d5-4d6a-9563-57e7c67743a1 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=65f4db5434134a4282bdfb93cbf76fe2, user.id=a88b1da9ec5844ffa8d7cdaf5c7438ce) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:41:57.747390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6bec2-83d5-4d6a-9563-57e7c67743a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:41:57.748811 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6bec2-83d5-4d6a-9563-57e7c67743a1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:41:57.754594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 573/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:41:57 2022] GET /identity/v3/role_assignments?user.id=a88b1da9ec5844ffa8d7cdaf5c7438ce&scope.project.id=65f4db5434134a4282bdfb93cbf76fe2&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:00.024428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de2b5-8f36-40ee-993e-20a651ca3354 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:00.024981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de2b5-8f36-40ee-993e-20a651ca3354 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:00.024981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7de2b5-8f36-40ee-993e-20a651ca3354 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:00.026785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 589/1162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:42:00.032993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d142a9-9e16-4e0b-8e60-c932e9f5725d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:00.033722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d142a9-9e16-4e0b-8e60-c932e9f5725d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:00.033867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d142a9-9e16-4e0b-8e60-c932e9f5725d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:00.056180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-66d142a9-9e16-4e0b-8e60-c932e9f5725d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:42:00.057340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-66d142a9-9e16-4e0b-8e60-c932e9f5725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:42:00.124374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 574/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:42:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:42:00.152892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7de2b5-8f36-40ee-993e-20a651ca3354 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:00.256097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7de2b5-8f36-40ee-993e-20a651ca3354 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:00.288701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:00.289323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:00.289601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:00.289871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:00.354794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:00.356254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:00.451234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 590/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:42:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:42:00.458135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d142a9-9e16-4e0b-8e60-c932e9f5725d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:00.571356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d142a9-9e16-4e0b-8e60-c932e9f5725d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:00.606891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1e78c-4ed7-4d5c-be22-51ab7e2284d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:00.607689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1e78c-4ed7-4d5c-be22-51ab7e2284d6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:00.607975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1e78c-4ed7-4d5c-be22-51ab7e2284d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:00.608222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1e78c-4ed7-4d5c-be22-51ab7e2284d6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:00.615643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1e78c-4ed7-4d5c-be22-51ab7e2284d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:00.617084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1e78c-4ed7-4d5c-be22-51ab7e2284d6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:00.631929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-29e1e78c-4ed7-4d5c-be22-51ab7e2284d6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 24 14:42:00.633079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 575/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:42:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:42:00.639322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:00.736231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12a96b-c031-4a02-92a8-819227a185bc None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:00.769285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2656eb1-1988-40ec-8a24-7359a6c6293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:00.769928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656eb1-1988-40ec-8a24-7359a6c6293a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:00.770239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656eb1-1988-40ec-8a24-7359a6c6293a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:00.770509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656eb1-1988-40ec-8a24-7359a6c6293a None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:00.771222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2656eb1-1988-40ec-8a24-7359a6c6293a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:42:00.771525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2656eb1-1988-40ec-8a24-7359a6c6293a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:00.772873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2656eb1-1988-40ec-8a24-7359a6c6293a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:00.779912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 591/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Mar 24 14:42:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:03.070104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e991-db77-4362-9f81-0fedf69229ee None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:03.070702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e991-db77-4362-9f81-0fedf69229ee None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:03.070702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e991-db77-4362-9f81-0fedf69229ee None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:03.072556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 576/1167] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:42:03.078954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04ce1-1828-4483-a171-5d9f6f1ae430 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:03.080025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04ce1-1828-4483-a171-5d9f6f1ae430 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:03.080178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04ce1-1828-4483-a171-5d9f6f1ae430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:03.108729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e1d04ce1-1828-4483-a171-5d9f6f1ae430 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:42:03.109905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e1d04ce1-1828-4483-a171-5d9f6f1ae430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:42:03.177423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 592/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:42:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:42:03.210665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e991-db77-4362-9f81-0fedf69229ee None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:03.317581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e991-db77-4362-9f81-0fedf69229ee None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:03.351066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396c429-713d-43a0-b163-5a5780b850b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:03.351692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396c429-713d-43a0-b163-5a5780b850b1 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:03.351972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396c429-713d-43a0-b163-5a5780b850b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:03.352242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396c429-713d-43a0-b163-5a5780b850b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:03.352974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396c429-713d-43a0-b163-5a5780b850b1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:03.354367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396c429-713d-43a0-b163-5a5780b850b1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:03.373238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 577/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Mar 24 14:42:03 2022] POST /identity/v3/domains => generated 267 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:42:05.660592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf32c-f3aa-482f-9c86-8d8b8bd01db9 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:05.661480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf32c-f3aa-482f-9c86-8d8b8bd01db9 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:05.661480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf32c-f3aa-482f-9c86-8d8b8bd01db9 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:05.664358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 593/1170] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:42:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:42:05.672905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa093-72d9-4a04-ad16-b5a5b1cf1861 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:05.673328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa093-72d9-4a04-ad16-b5a5b1cf1861 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:05.673629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa093-72d9-4a04-ad16-b5a5b1cf1861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:05.696341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b83fa093-72d9-4a04-ad16-b5a5b1cf1861 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:42:05.697531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b83fa093-72d9-4a04-ad16-b5a5b1cf1861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:42:05.763035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 578/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:42:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:42:05.787295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf32c-f3aa-482f-9c86-8d8b8bd01db9 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:05.902160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf32c-f3aa-482f-9c86-8d8b8bd01db9 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:05.950594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7eaba-968b-475e-bcae-da38230b3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:05.951384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7eaba-968b-475e-bcae-da38230b3f14 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:05.951659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7eaba-968b-475e-bcae-da38230b3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:05.951927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7eaba-968b-475e-bcae-da38230b3f14 None admin] PATH_INFO: `/v3/domains/7a244a3efd8b47cea3765ebc51c48df2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:05.962598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7eaba-968b-475e-bcae-da38230b3f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7a244a3efd8b47cea3765ebc51c48df2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:05.964033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7eaba-968b-475e-bcae-da38230b3f14 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:05.965661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 594/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Mar 24 14:42:05 2022] GET /identity/v3/domains/7a244a3efd8b47cea3765ebc51c48df2 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:05.975135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fa093-72d9-4a04-ad16-b5a5b1cf1861 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:06.070099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fa093-72d9-4a04-ad16-b5a5b1cf1861 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:06.104078 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967d646-cf83-4db5-a3c7-d65dc2a8975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:06.104720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967d646-cf83-4db5-a3c7-d65dc2a8975a None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:06.105003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967d646-cf83-4db5-a3c7-d65dc2a8975a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:06.105279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967d646-cf83-4db5-a3c7-d65dc2a8975a None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:06.105989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967d646-cf83-4db5-a3c7-d65dc2a8975a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:06.107444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967d646-cf83-4db5-a3c7-d65dc2a8975a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:06.141223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 579/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:42:05 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:42:08.426142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c907-f8b9-4d97-b770-b51a6e4bfbda None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:08.426694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c907-f8b9-4d97-b770-b51a6e4bfbda None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:08.426694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c907-f8b9-4d97-b770-b51a6e4bfbda None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:08.429462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 595/1174] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:42:08.437357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5966a9d-0015-4464-98f4-f090d78ff0c6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:08.437822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5966a9d-0015-4464-98f4-f090d78ff0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:08.437925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5966a9d-0015-4464-98f4-f090d78ff0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:08.456703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a5966a9d-0015-4464-98f4-f090d78ff0c6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:42:08.457867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a5966a9d-0015-4464-98f4-f090d78ff0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:42:08.523390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 580/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:42:08.548228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c907-f8b9-4d97-b770-b51a6e4bfbda None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:08.648643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c907-f8b9-4d97-b770-b51a6e4bfbda None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:08.681875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896bbb2-3511-4b6c-a167-9234179bf810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:08.682688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896bbb2-3511-4b6c-a167-9234179bf810 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:08.682970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896bbb2-3511-4b6c-a167-9234179bf810 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:08.683237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896bbb2-3511-4b6c-a167-9234179bf810 None admin] PATH_INFO: `/v3/domains/7a244a3efd8b47cea3765ebc51c48df2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:08.684448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896bbb2-3511-4b6c-a167-9234179bf810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7a244a3efd8b47cea3765ebc51c48df2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:08.685872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896bbb2-3511-4b6c-a167-9234179bf810 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:08.687543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 596/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Mar 24 14:42:08 2022] GET /identity/v3/domains/7a244a3efd8b47cea3765ebc51c48df2 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:08.696365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5966a9d-0015-4464-98f4-f090d78ff0c6 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:08.797833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5966a9d-0015-4464-98f4-f090d78ff0c6 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:08.832335 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eff8a-f7a0-40d5-9aa6-bb1d99226810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:08.832984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eff8a-f7a0-40d5-9aa6-bb1d99226810 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:08.833260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eff8a-f7a0-40d5-9aa6-bb1d99226810 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:08.833539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eff8a-f7a0-40d5-9aa6-bb1d99226810 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:08.834269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eff8a-f7a0-40d5-9aa6-bb1d99226810 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:08.835695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eff8a-f7a0-40d5-9aa6-bb1d99226810 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:08.861167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 581/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:42:08 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:42:11.145634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a76951-d366-4393-9b19-06b4096f534a None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:11.146611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a76951-d366-4393-9b19-06b4096f534a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:11.146611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a76951-d366-4393-9b19-06b4096f534a None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:11.149495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 597/1178] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:42:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:42:11.155191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e710c3-1a78-4b3b-b229-ab5859fec485 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:11.155609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e710c3-1a78-4b3b-b229-ab5859fec485 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:11.155609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e710c3-1a78-4b3b-b229-ab5859fec485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:11.172804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e2e710c3-1a78-4b3b-b229-ab5859fec485 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:42:11.173975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e2e710c3-1a78-4b3b-b229-ab5859fec485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:42:11.239421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 582/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:42:11.263020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a76951-d366-4393-9b19-06b4096f534a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:11.371058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a76951-d366-4393-9b19-06b4096f534a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:11.404132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:11.404908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:11.405278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:11.405492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:11.416132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:42:11.422985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:42:11.424123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 598/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:42:11.433719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e710c3-1a78-4b3b-b229-ab5859fec485 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:11.538015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e710c3-1a78-4b3b-b229-ab5859fec485 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:11.571471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:11.572111 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:11.572386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:11.572656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:11.573400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:42:11.573700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:11.575103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:11.583358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 583/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:11.589323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:11.697494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7aa967-8a3f-4404-b7c3-c711d490095b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:11.733522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:11.734417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:11.734694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:11.734967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] PATH_INFO: `/v3/users/3515d1e54fd2469d95c9333cad845733` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:11.747908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] RBAC: Authorizing `identity:get_user(user_id=3515d1e54fd2469d95c9333cad845733)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:11.749404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:11.751086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 599/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:42:11 2022] GET /identity/v3/users/3515d1e54fd2469d95c9333cad845733 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:11.757272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:11.854786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99ec2-c8c6-477a-8fba-2772ad26aa35 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:11.893532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:11.894201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:11.894480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:11.894748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:11.960812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:11.962297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:12.058063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 584/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:42:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:42:12.064504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:12.161959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cdf33-54c7-4643-a2b5-0213eb3eec49 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:12.195368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a75b-8330-43f1-8073-dd33fc960022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:12.196213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a75b-8330-43f1-8073-dd33fc960022 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:12.196496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a75b-8330-43f1-8073-dd33fc960022 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:12.196763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a75b-8330-43f1-8073-dd33fc960022 None admin] PATH_INFO: `/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:12.197989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09a75b-8330-43f1-8073-dd33fc960022 None admin] RBAC: Authorizing `identity:get_project(project_id=acb8d02528cd47c6a2d53aad0169cc5b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:12.199444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09a75b-8330-43f1-8073-dd33fc960022 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:12.201099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 600/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:42:12 2022] GET /identity/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:12.208178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:12.309630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69b1be-45cb-46fd-b6c3-44b86d3e3e20 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:12.344866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6f3c0-fa42-4597-8cfb-4c3e48aa12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:12.345502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6f3c0-fa42-4597-8cfb-4c3e48aa12d6 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:12.345778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6f3c0-fa42-4597-8cfb-4c3e48aa12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:12.346046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6f3c0-fa42-4597-8cfb-4c3e48aa12d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:12.346913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6f3c0-fa42-4597-8cfb-4c3e48aa12d6 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=acb8d02528cd47c6a2d53aad0169cc5b, user.id=3515d1e54fd2469d95c9333cad845733) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:42:12.347210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6f3c0-fa42-4597-8cfb-4c3e48aa12d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:12.348641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6f3c0-fa42-4597-8cfb-4c3e48aa12d6 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:12.354039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 585/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:42:12 2022] GET /identity/v3/role_assignments?user.id=3515d1e54fd2469d95c9333cad845733&scope.project.id=acb8d02528cd47c6a2d53aad0169cc5b&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:14.581157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd43126-244b-43e5-b437-af604b00cbbc None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:14.581731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd43126-244b-43e5-b437-af604b00cbbc None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:14.581731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd43126-244b-43e5-b437-af604b00cbbc None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:14.583520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 601/1186] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:42:14.589839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d5318-5ace-4945-ad9e-dff136e5c645 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:14.590626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d5318-5ace-4945-ad9e-dff136e5c645 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:14.590772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d5318-5ace-4945-ad9e-dff136e5c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:14.610420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4f3d5318-5ace-4945-ad9e-dff136e5c645 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:42:14.611609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4f3d5318-5ace-4945-ad9e-dff136e5c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:42:14.676805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 586/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:42:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:42:14.699417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd43126-244b-43e5-b437-af604b00cbbc None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:14.808304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd43126-244b-43e5-b437-af604b00cbbc None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:14.841904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:14.842691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:14.842972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:14.843243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:14.853496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:42:14.860375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:42:14.861522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 602/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:42:14.867842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d5318-5ace-4945-ad9e-dff136e5c645 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:14.970820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d5318-5ace-4945-ad9e-dff136e5c645 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:15.004272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:15.004924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:15.005202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:15.005474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:15.006244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:42:15.006551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:15.007925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:15.015854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 587/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:15.022509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:15.130936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ce027-ded0-42c2-bab8-7404a319bd1d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:15.164041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:15.164888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:15.165164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:15.165430 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] PATH_INFO: `/v3/users/3515d1e54fd2469d95c9333cad845733` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:15.166732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] RBAC: Authorizing `identity:get_user(user_id=3515d1e54fd2469d95c9333cad845733)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:15.168156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:15.169756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 603/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:42:15 2022] GET /identity/v3/users/3515d1e54fd2469d95c9333cad845733 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:15.175604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:15.276953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358ff1d-1a5d-4107-8778-0e083e151739 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:15.309850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d857168-e5be-4a28-9d94-38f59b3c6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:15.310731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857168-e5be-4a28-9d94-38f59b3c6232 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:15.311008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857168-e5be-4a28-9d94-38f59b3c6232 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:15.311333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d857168-e5be-4a28-9d94-38f59b3c6232 None admin] PATH_INFO: `/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:15.312548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d857168-e5be-4a28-9d94-38f59b3c6232 None admin] RBAC: Authorizing `identity:get_project(project_id=acb8d02528cd47c6a2d53aad0169cc5b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:15.313965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d857168-e5be-4a28-9d94-38f59b3c6232 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:15.315631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 588/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:42:15 2022] GET /identity/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:15.322138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:15.431089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536c5f6-fa09-4b53-9ddd-51c1014679f1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:15.464554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a149ec-9b3e-4fee-bcf1-2481a1d5daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:15.465420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a149ec-9b3e-4fee-bcf1-2481a1d5daad None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:15.465701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a149ec-9b3e-4fee-bcf1-2481a1d5daad None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:15.465972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a149ec-9b3e-4fee-bcf1-2481a1d5daad None admin] PATH_INFO: `/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b/users/3515d1e54fd2469d95c9333cad845733/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:15.468298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a149ec-9b3e-4fee-bcf1-2481a1d5daad None admin] RBAC: Authorizing `identity:create_grant(project_id=acb8d02528cd47c6a2d53aad0169cc5b, user_id=3515d1e54fd2469d95c9333cad845733, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:15.469716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a149ec-9b3e-4fee-bcf1-2481a1d5daad None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:15.485890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 604/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:42:15 2022] PUT /identity/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b/users/3515d1e54fd2469d95c9333cad845733/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:42:17.720425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8a35-d2bc-41b1-b04a-88e90720d531 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:17.721012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8a35-d2bc-41b1-b04a-88e90720d531 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:17.721012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b8a35-d2bc-41b1-b04a-88e90720d531 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:17.722747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 589/1193] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:42:17.729154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60155-793d-408b-b2dc-63e2dcb8895c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:17.729884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60155-793d-408b-b2dc-63e2dcb8895c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:17.730029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a60155-793d-408b-b2dc-63e2dcb8895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:17.754786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-85a60155-793d-408b-b2dc-63e2dcb8895c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:42:17.755978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-85a60155-793d-408b-b2dc-63e2dcb8895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:42:17.823603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 605/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:42:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:42:17.854855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8a35-d2bc-41b1-b04a-88e90720d531 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:17.960150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b8a35-d2bc-41b1-b04a-88e90720d531 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:17.996144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:17.996857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:17.997136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:17.997405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:18.007702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:42:18.014442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:42:18.015617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 590/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:42:18.022739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60155-793d-408b-b2dc-63e2dcb8895c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:18.131968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a60155-793d-408b-b2dc-63e2dcb8895c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:18.174251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:18.174919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:18.175198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:18.175467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:18.176220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:42:18.176525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:18.177897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:18.186382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 606/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:18.192756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:18.299216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f634033-fd65-41b0-81b3-1048b822b0ae None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:18.339247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:18.340091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:18.340368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:18.340638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] PATH_INFO: `/v3/users/3515d1e54fd2469d95c9333cad845733` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:18.341925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] RBAC: Authorizing `identity:get_user(user_id=3515d1e54fd2469d95c9333cad845733)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:18.343424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:18.345000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 591/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Mar 24 14:42:18 2022] GET /identity/v3/users/3515d1e54fd2469d95c9333cad845733 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:18.350762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:18.450248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a39ea7-64a8-4d6a-b5fd-ff718c4a9263 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:18.484060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:18.484693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:18.484976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:18.485252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:18.550692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:18.552073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:18.647616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 607/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:42:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:42:18.656244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:18.750402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5258d6-72b6-4c8f-a19d-dda7d9d05a18 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:18.784739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b589c-1c80-404e-b849-1f32cf8f4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:18.785569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b589c-1c80-404e-b849-1f32cf8f4f0a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:18.785840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b589c-1c80-404e-b849-1f32cf8f4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:18.786127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b589c-1c80-404e-b849-1f32cf8f4f0a None admin] PATH_INFO: `/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:18.787419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b589c-1c80-404e-b849-1f32cf8f4f0a None admin] RBAC: Authorizing `identity:get_project(project_id=acb8d02528cd47c6a2d53aad0169cc5b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:18.788833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b589c-1c80-404e-b849-1f32cf8f4f0a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:18.790491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 592/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Mar 24 14:42:18 2022] GET /identity/v3/projects/acb8d02528cd47c6a2d53aad0169cc5b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:42:18.798598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:42:18.895922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66ae7d-728a-43bb-a8de-fa3c4a0fbaa2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:42:18.930283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcae6d-e005-4a39-a9c6-8ecaa42dc0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:42:18.930923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcae6d-e005-4a39-a9c6-8ecaa42dc0ab None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:42:18.931201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcae6d-e005-4a39-a9c6-8ecaa42dc0ab None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:42:18.931471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcae6d-e005-4a39-a9c6-8ecaa42dc0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:42:18.932295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcae6d-e005-4a39-a9c6-8ecaa42dc0ab None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=acb8d02528cd47c6a2d53aad0169cc5b, user.id=3515d1e54fd2469d95c9333cad845733) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:42:18.932602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcae6d-e005-4a39-a9c6-8ecaa42dc0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:42:18.934034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcae6d-e005-4a39-a9c6-8ecaa42dc0ab None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:42:18.939932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 608/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:42:18 2022] GET /identity/v3/role_assignments?user.id=3515d1e54fd2469d95c9333cad845733&scope.project.id=acb8d02528cd47c6a2d53aad0169cc5b&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:20.075756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e29086-4814-4196-9d86-9a4314027c0f None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:20.076390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e29086-4814-4196-9d86-9a4314027c0f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:20.076390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e29086-4814-4196-9d86-9a4314027c0f None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:20.078259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 593/1201] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:20.084382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647fca-32bf-46ef-a27d-e456b9853e1c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:20.085001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647fca-32bf-46ef-a27d-e456b9853e1c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:20.085001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647fca-32bf-46ef-a27d-e456b9853e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:20.102845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f8647fca-32bf-46ef-a27d-e456b9853e1c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:20.104037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f8647fca-32bf-46ef-a27d-e456b9853e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:20.183042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 609/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:43:20.208461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e29086-4814-4196-9d86-9a4314027c0f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:20.315731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e29086-4814-4196-9d86-9a4314027c0f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:20.364280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:20.365100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:20.365372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:20.365639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:20.376426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:20.377931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:20.398284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:20.399469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 594/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:20.405408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8647fca-32bf-46ef-a27d-e456b9853e1c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:20.515321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8647fca-32bf-46ef-a27d-e456b9853e1c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:20.548671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110394-cd35-4346-b786-ed1e147959b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:20.549340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110394-cd35-4346-b786-ed1e147959b3 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:20.549657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110394-cd35-4346-b786-ed1e147959b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:20.549893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110394-cd35-4346-b786-ed1e147959b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:20.550735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4110394-cd35-4346-b786-ed1e147959b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:20.551067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4110394-cd35-4346-b786-ed1e147959b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:20.552407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4110394-cd35-4346-b786-ed1e147959b3 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:20.565304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 610/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:43:20.570807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:20.691591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abdcf8-d11f-4da6-aaeb-74efda294f8b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:20.738630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8b50-6f92-496c-be53-5d21f830d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:20.739515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8b50-6f92-496c-be53-5d21f830d0b1 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:20.739744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8b50-6f92-496c-be53-5d21f830d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:20.740259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8b50-6f92-496c-be53-5d21f830d0b1 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:20.741244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8b50-6f92-496c-be53-5d21f830d0b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:20.742945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8b50-6f92-496c-be53-5d21f830d0b1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:20.773992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 595/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Mar 24 14:43:20 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:43:23.231637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3abf-8ca3-4b08-a17a-8b424deb9004 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:23.232165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3abf-8ca3-4b08-a17a-8b424deb9004 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:23.232165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3abf-8ca3-4b08-a17a-8b424deb9004 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:23.233753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 611/1206] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:23.239869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d887b4-6c34-4e96-9a93-3dbb1a6c25b1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:23.240428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d887b4-6c34-4e96-9a93-3dbb1a6c25b1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:23.240428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d887b4-6c34-4e96-9a93-3dbb1a6c25b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:23.259555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-45d887b4-6c34-4e96-9a93-3dbb1a6c25b1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:23.260823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-45d887b4-6c34-4e96-9a93-3dbb1a6c25b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:23.337219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 596/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:23.363099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c3abf-8ca3-4b08-a17a-8b424deb9004 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:23.474056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c3abf-8ca3-4b08-a17a-8b424deb9004 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:23.513064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:23.513834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:23.514138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:23.514432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:23.530422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:43:23.537585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:43:23.538920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 612/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:23.545720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d887b4-6c34-4e96-9a93-3dbb1a6c25b1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:23.653273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d887b4-6c34-4e96-9a93-3dbb1a6c25b1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:23.691744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:23.692411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:23.692737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:23.692957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:23.693704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:23.694020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:23.695394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:23.703657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 597/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:43:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:23.709706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:23.815220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c82d0-1423-40b1-b805-4294e4617523 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:23.851729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:23.852648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:23.852930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:23.853317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:23.865085 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:23.865856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:23.889678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:23.891218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 613/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:43:23.896734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:23.999206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31e2d-479c-4a9a-a997-3618bf316853 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:24.038475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:24.039189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:24.039467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:24.039773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:24.040595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:24.040967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:24.042572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:24.062449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 598/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:43:24.063883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:24.182442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a87dd-dcc2-4ea0-9eb1-47c2f2e62981 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:24.215981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:24.216835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:24.217057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:24.217335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:24.225360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:24.226933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:24.241777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 24 14:43:24.247718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 614/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:24.250176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:24.484523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d40db-3a88-41ef-8396-36ebb7119b9d None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:24.532113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:24.532880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:24.533155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:24.533449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:24.534425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:24.534792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:24.536601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:24.559775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 599/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Mar 24 14:43:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:24.561131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:24.667527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd43970-7ee4-4615-bc88-06a5670de008 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:24.702600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:24.703542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:24.703820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:24.704433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:24.771580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:24.773043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:24.872325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 615/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:43:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 24 14:43:24.873844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:24.975675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff21b6-8e2d-4261-922e-2a3c05a8657e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:25.009380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:25.010383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:25.010730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:25.011691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:25.022110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:25.023602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:25.040085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:25.041391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 600/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:25.047433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:25.143305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830777d-3b6f-4507-a4bc-5c5058770395 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:25.176559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:25.177370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:25.177750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:25.178146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:25.178965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:25.179368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:25.180824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:25.192624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 616/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:25.198053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:25.297199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423b1d0-9260-4795-9265-ef9647b4b0c3 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:25.333933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:25.333933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:25.333933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:25.333933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:25.342241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:25.344480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:25.358327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:43:25.359723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 601/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:25.365494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:25.473440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea307576-a9bb-420a-8ab8-bea2b3041ace None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:25.507583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c44f8-1cdd-4c06-9e98-779ee1b60ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:25.508244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c44f8-1cdd-4c06-9e98-779ee1b60ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:25.508530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c44f8-1cdd-4c06-9e98-779ee1b60ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:25.508794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c44f8-1cdd-4c06-9e98-779ee1b60ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:25.509573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c44f8-1cdd-4c06-9e98-779ee1b60ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:25.509877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c44f8-1cdd-4c06-9e98-779ee1b60ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:25.511340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c44f8-1cdd-4c06-9e98-779ee1b60ac7 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:25.523819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 617/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:25.529744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:25.632312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf5ad2-5dff-43b2-9a83-b95386bb3ac4 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:25.666552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28dd2b-5e33-4326-9fe7-c97dbc1c66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:25.667233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28dd2b-5e33-4326-9fe7-c97dbc1c66ec None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:25.667509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28dd2b-5e33-4326-9fe7-c97dbc1c66ec None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:25.667788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28dd2b-5e33-4326-9fe7-c97dbc1c66ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:25.668644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28dd2b-5e33-4326-9fe7-c97dbc1c66ec None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ca33f2f8bb0a4631912f0ed51c6f8c87) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:25.669014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28dd2b-5e33-4326-9fe7-c97dbc1c66ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:25.670532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28dd2b-5e33-4326-9fe7-c97dbc1c66ec None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:25.676885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 602/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:43:25 2022] GET /identity/v3/role_assignments?user.id=ca33f2f8bb0a4631912f0ed51c6f8c87&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:28.128307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34f191-235b-4547-97ae-98663b0b3c87 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:28.128927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34f191-235b-4547-97ae-98663b0b3c87 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:28.128927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34f191-235b-4547-97ae-98663b0b3c87 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:28.130674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 618/1220] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:28.136286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556976a-76c8-4e81-b768-0a1f8cdd31d6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:28.136743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556976a-76c8-4e81-b768-0a1f8cdd31d6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:28.136837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556976a-76c8-4e81-b768-0a1f8cdd31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:28.158907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-8556976a-76c8-4e81-b768-0a1f8cdd31d6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:28.160017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8556976a-76c8-4e81-b768-0a1f8cdd31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:28.232654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 603/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:28.258706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34f191-235b-4547-97ae-98663b0b3c87 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:28.365995 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34f191-235b-4547-97ae-98663b0b3c87 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:28.398952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:28.399776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:28.400018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:28.400286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:28.410451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:43:28.417224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:43:28.418443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 619/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:28.424550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556976a-76c8-4e81-b768-0a1f8cdd31d6 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:28.524889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556976a-76c8-4e81-b768-0a1f8cdd31d6 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:28.557256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:28.557915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:28.558203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:28.558495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:28.559207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] RBAC: Adding query filter params (name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:28.559685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:28.561056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:28.569153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 604/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:28.575412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:28.682817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde0d9b-d4e4-4e3d-9c1c-4e1163638b9b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:28.720638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:28.721428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:28.721708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:28.721979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:28.732121 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:28.733758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:28.752565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:28.757789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 620/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:28.759822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:28.868300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb71754-9223-487b-9b6f-672aef437d50 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:28.906715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:28.907387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:28.907683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:28.907946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:28.908678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:28.908980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:28.910373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:28.922892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 605/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:28.928846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:29.038551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5962096-dcba-4da0-a189-934e0b31f8f1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:29.072040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:29.072846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:29.073128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:29.073403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:29.082662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:29.084306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:29.100609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 24 14:43:29.101985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 621/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:29.109194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:29.215793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd141-0b1f-49d3-bfac-cf7f6e96d961 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:29.255360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:29.256179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:29.256457 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:29.256787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:29.257853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:29.258218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:29.259864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:29.278579 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 606/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Mar 24 14:43:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:29.284336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:29.386238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ce84-1af0-45ee-b174-e6570ddb300e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:29.423435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:29.424361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:29.424673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:29.424948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:29.436611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:29.438204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:29.453877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:29.455399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 622/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:29.461253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:29.565158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c7de-ca1d-4d3d-a968-5a5fd3bd0774 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:29.598864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:29.599633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:29.599894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:29.600166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:29.600883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:29.601311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:29.602902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:29.614216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 607/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:29.620489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:29.736711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2310385-9bb8-4a3a-97af-0a1484b5b99e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:29.769893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:29.770777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:29.771060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:29.771333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:29.778533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:29.779987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:29.793189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:43:29.794595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 623/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:29.800714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:29.909781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de080eed-bd9f-4e5a-b556-7394da7d8e87 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:29.946300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c0bab-9005-4004-b743-683e2c87162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:29.947024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c0bab-9005-4004-b743-683e2c87162e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:29.947283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c0bab-9005-4004-b743-683e2c87162e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:29.947682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c0bab-9005-4004-b743-683e2c87162e None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:29.948808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c0bab-9005-4004-b743-683e2c87162e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:29.949186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c0bab-9005-4004-b743-683e2c87162e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:29.951132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c0bab-9005-4004-b743-683e2c87162e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:29.963989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 608/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:29.970114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:30.080085 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d137-e111-4326-af10-590069b3fd8a None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:30.118297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e9d44-286d-4b02-8288-9eb7d8188179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:30.119429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e9d44-286d-4b02-8288-9eb7d8188179 None admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:30.119784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e9d44-286d-4b02-8288-9eb7d8188179 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:30.120116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e9d44-286d-4b02-8288-9eb7d8188179 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/ca33f2f8bb0a4631912f0ed51c6f8c87/roles/da56ace2cb7e42d29ebc9789d9f3c756` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:30.135375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e9d44-286d-4b02-8288-9eb7d8188179 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=ca33f2f8bb0a4631912f0ed51c6f8c87, role_id=da56ace2cb7e42d29ebc9789d9f3c756)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:30.137069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e9d44-286d-4b02-8288-9eb7d8188179 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:30.150672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 624/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:43:29 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/ca33f2f8bb0a4631912f0ed51c6f8c87/roles/da56ace2cb7e42d29ebc9789d9f3c756 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:43:32.436503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c249-3984-404f-bfc4-2d9024dd9432 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:32.437073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c249-3984-404f-bfc4-2d9024dd9432 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:32.437073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c249-3984-404f-bfc4-2d9024dd9432 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:32.438841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 609/1233] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:32.444173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7ec44-12cb-48b6-995d-b0fadef6d73d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:32.444596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7ec44-12cb-48b6-995d-b0fadef6d73d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:32.444732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7ec44-12cb-48b6-995d-b0fadef6d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:32.462986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-dcc7ec44-12cb-48b6-995d-b0fadef6d73d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:32.464229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dcc7ec44-12cb-48b6-995d-b0fadef6d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:32.529194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 625/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:32.556019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c249-3984-404f-bfc4-2d9024dd9432 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:32.661473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c249-3984-404f-bfc4-2d9024dd9432 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:32.701147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:32.701866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:32.702202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:32.702516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] PATH_INFO: `/v3/roles/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:32.713734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:43:32.721209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 24 14:43:32.722509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 610/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Mar 24 14:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:43:32.729516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7ec44-12cb-48b6-995d-b0fadef6d73d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:32.831109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7ec44-12cb-48b6-995d-b0fadef6d73d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:32.867371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:32.868078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:32.868354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:32.868631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:32.869398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:32.869698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:32.871226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:32.881246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 626/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Mar 24 14:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:32.887299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:32.998203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a38a5-22ae-4c8d-af86-9808b5525dae None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:33.041273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:33.042685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:33.042995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:33.043352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:33.057440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:33.059098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:33.077547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:33.078987 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 611/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:43:33.085152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:33.189566 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eba5e-041c-4594-aff3-3bfbc32dd2b2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:33.225631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:33.226454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:33.226791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:33.227068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:33.227781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:33.228081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:33.229441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:33.243730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 627/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:33.249786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:33.353020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5464c4-1f50-46a1-bc5b-c7e342ba94fe None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:33.387881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:33.388790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:33.389240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:33.389625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:33.397172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:33.398625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:33.413250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 24 14:43:33.414909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 612/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:33.421239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:33.531545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7164ac8-4b96-474c-ad9a-525c311ab397 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:33.566779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:33.567459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:33.567740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:33.568008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:33.568860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:33.569153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:33.570639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:33.588841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 628/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Mar 24 14:43:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:33.594708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:33.702124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed21795-a6f0-4fdd-ab0d-744a5248bea3 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:33.738344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:33.738999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:33.739291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:33.739595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:33.809324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:33.810777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:33.912956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 613/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:43:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:43:33.918902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:34.021999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df76ea-0893-47ba-b62c-698bfb67c54b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:34.062450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:34.063509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:34.063919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:34.064530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:34.078131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:34.078131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:34.094846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:34.096055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 629/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:34.101913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:34.196205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e434948-60c4-4eaf-bf2a-bab26965f808 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:34.240412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:34.240412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:34.240412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:34.240412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:34.240861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:34.240861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:34.240861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:34.251524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 614/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:34.257205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:34.363018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b65e3-0f44-4e41-9537-20b5209bbcb9 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:34.399594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:34.400630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:34.400948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:34.401315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:34.408710 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:34.410262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:34.423534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:43:34.424813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 630/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:34.431387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:34.530228 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0f02a-43db-4df2-bfd6-70ed3967bd52 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:34.568199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058001e-a0bb-4edd-b478-b9a373328411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:34.568864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058001e-a0bb-4edd-b478-b9a373328411 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:34.569146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058001e-a0bb-4edd-b478-b9a373328411 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:34.569417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058001e-a0bb-4edd-b478-b9a373328411 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:34.570243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058001e-a0bb-4edd-b478-b9a373328411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:34.570570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058001e-a0bb-4edd-b478-b9a373328411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:34.571998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058001e-a0bb-4edd-b478-b9a373328411 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:34.585014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 615/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:34.591505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:34.700128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f56ad-4e78-4d39-82fa-a27b28d3dcb1 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:34.736383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a55e7-b0c5-41cd-83cf-b39d99689842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:34.737078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a55e7-b0c5-41cd-83cf-b39d99689842 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:34.737358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a55e7-b0c5-41cd-83cf-b39d99689842 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:34.737614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a55e7-b0c5-41cd-83cf-b39d99689842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:34.738478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a55e7-b0c5-41cd-83cf-b39d99689842 None admin] RBAC: Adding query filter params (role.id=da56ace2cb7e42d29ebc9789d9f3c756, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ca33f2f8bb0a4631912f0ed51c6f8c87) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:34.738792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a55e7-b0c5-41cd-83cf-b39d99689842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:34.740219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a55e7-b0c5-41cd-83cf-b39d99689842 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:34.746322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 631/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:43:34 2022] GET /identity/v3/role_assignments?user.id=ca33f2f8bb0a4631912f0ed51c6f8c87&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=da56ace2cb7e42d29ebc9789d9f3c756 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:37.112367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071960f-54eb-4587-94fe-b4636452c957 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:37.112999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071960f-54eb-4587-94fe-b4636452c957 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:37.112999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071960f-54eb-4587-94fe-b4636452c957 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:37.114858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 616/1247] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:37.120464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9d369-09ab-420a-b627-f042b80be671 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:37.120954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9d369-09ab-420a-b627-f042b80be671 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:37.121057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9d369-09ab-420a-b627-f042b80be671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:37.140074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2ce9d369-09ab-420a-b627-f042b80be671 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:37.141245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2ce9d369-09ab-420a-b627-f042b80be671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:37.215501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 632/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:37.242008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071960f-54eb-4587-94fe-b4636452c957 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:37.352295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071960f-54eb-4587-94fe-b4636452c957 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:37.390954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:37.391755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:37.392038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:37.392328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:37.402608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:43:37.410623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:43:37.411825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 617/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:37.420229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9d369-09ab-420a-b627-f042b80be671 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:37.516336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9d369-09ab-420a-b627-f042b80be671 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:37.550055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:37.550757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:37.551042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:37.551319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:37.552077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:37.552373 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:37.553748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:37.561910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 633/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:43:37.567575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:37.675766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f29cf5-17ae-4e2a-b06f-646a0fe0e7fe None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:37.710126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:37.710918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:37.711197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:37.711468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:37.722869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:37.724597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:37.741671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:37.742910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 618/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:37.748765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:37.845828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef2f27-94e8-4c36-b921-f50878d4cbf8 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:37.881945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:37.882640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:37.882920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:37.883261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:37.884041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:37.884344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:37.885923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:37.899891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 634/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:37.906252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:38.016632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0f25-2f37-45d1-b51b-682fcac0ce4a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:38.058689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:38.059836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:38.060249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:38.060549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:38.071372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:38.072988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:38.088610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 24 14:43:38.090376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 619/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:38.097275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:38.202043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdf31e-8dd9-4e36-bc54-28aeec51ec3d None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:38.238708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:38.240299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:38.240570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:38.240836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:38.241671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:38.241972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:38.243604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:38.261440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 635/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Mar 24 14:43:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:38.267183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:38.364980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d55c-cb48-4e13-ab9c-f88df8a59828 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:38.399163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:38.399918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:38.400203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:38.400480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:38.470411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:38.472074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:38.572658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 620/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:43:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:43:38.578490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:38.679062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a7d1f-cd2a-45aa-abd8-2aaa4fd3ed84 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:38.714783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:38.715574 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:38.715850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:38.716123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:38.728086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:38.729673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:38.747443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:38.748875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 636/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:38.754640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:38.859570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92985954-3a56-4977-a23c-319e7840e845 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:38.895778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:38.896549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:38.896854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:38.897156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:38.898158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:38.898497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:38.900141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:38.912265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 621/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:38.919089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:39.034189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd610561-070a-44a9-8234-1e0660cf8b29 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:39.081847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:39.082703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:39.083009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:39.083284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:39.091303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:39.092945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:39.107316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:43:39.110249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 637/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:39.115097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:39.224297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0954b-ae79-4741-8fbc-dff4327092cd None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:39.257546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe931849-e695-4336-a144-38cf5344f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:39.258237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe931849-e695-4336-a144-38cf5344f600 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:39.258514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe931849-e695-4336-a144-38cf5344f600 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:39.258782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe931849-e695-4336-a144-38cf5344f600 None admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:39.259570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe931849-e695-4336-a144-38cf5344f600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:39.259870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe931849-e695-4336-a144-38cf5344f600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:39.261306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe931849-e695-4336-a144-38cf5344f600 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:39.274688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 622/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:43:39.281157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:39.379614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4317c-f164-4f35-9a4a-0242ee5d3eb2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:39.413046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3be9b-bd17-4ce5-8b75-19d66079ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:39.413701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3be9b-bd17-4ce5-8b75-19d66079ce69 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:39.413981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3be9b-bd17-4ce5-8b75-19d66079ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:39.414285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3be9b-bd17-4ce5-8b75-19d66079ce69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:39.415103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3be9b-bd17-4ce5-8b75-19d66079ce69 None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ca33f2f8bb0a4631912f0ed51c6f8c87) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:39.415432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3be9b-bd17-4ce5-8b75-19d66079ce69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:39.416841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3be9b-bd17-4ce5-8b75-19d66079ce69 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:39.422346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 638/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:43:39 2022] GET /identity/v3/role_assignments?user.id=ca33f2f8bb0a4631912f0ed51c6f8c87&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:41.653354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6bef-8c63-4471-b8d0-8fe694e13e4c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:41.653912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6bef-8c63-4471-b8d0-8fe694e13e4c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:41.653912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6bef-8c63-4471-b8d0-8fe694e13e4c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:41.655721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 623/1261] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:41.662032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa58f7-dc96-4c74-a5ec-cb1e94839125 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:41.662804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa58f7-dc96-4c74-a5ec-cb1e94839125 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:41.662922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa58f7-dc96-4c74-a5ec-cb1e94839125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:41.684196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-72aa58f7-dc96-4c74-a5ec-cb1e94839125 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:41.685379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-72aa58f7-dc96-4c74-a5ec-cb1e94839125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:41.757359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 639/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:41.779970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6bef-8c63-4471-b8d0-8fe694e13e4c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:41.881905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6bef-8c63-4471-b8d0-8fe694e13e4c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:41.915528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:41.916257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:41.916534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:41.916809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:41.927688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:43:41.934575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:43:41.935990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 624/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:41.942197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa58f7-dc96-4c74-a5ec-cb1e94839125 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:42.055472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa58f7-dc96-4c74-a5ec-cb1e94839125 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:42.095118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:42.095790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:42.096072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:42.096345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:42.097086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:42.097391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:42.098792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:42.107016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 640/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:42.113270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:42.217500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c211e2-8d91-4312-822f-2f26610789db None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:42.252966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:42.253777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:42.254057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:42.254366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:42.266104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:42.267543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:42.284763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:42.285921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 625/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:42.292076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:42.388618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db3860-a3c9-4a1e-8a73-c3f05cd574cd None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:42.422034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:42.422711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:42.422992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:42.423260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:42.423971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:42.424274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:42.425634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:42.437117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 641/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:42.443057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:42.551020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694570a-ec76-4a95-9ce4-bc4ce3b45284 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:42.583607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:42.584379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:42.584653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:42.584905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:42.592022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:42.593470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:42.606589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 24 14:43:42.607708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 626/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:43:42.616474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:42.715531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633852f-0543-4401-9542-d1903f134fe2 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:42.761598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:42.762280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:42.762562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:42.762837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:42.763663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:42.763970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:42.765395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:42.781982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 642/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Mar 24 14:43:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:42.787748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:42.898718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc48cd2-467d-47ee-abf6-430a3f12837b None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:42.947563 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:42.948353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:42.948634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:42.948912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:42.959950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:42.961375 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:42.977401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:42.978576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 627/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 24 14:43:42.984574 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:43.103898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f71c-406c-4bc0-8dc1-45d5ca0d80fb None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:43.137742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:43.138432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:43.138712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:43.138984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:43.139694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:43.139999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:43.141366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:43.152523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 643/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:43.158346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:43.260186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cdc5f-6f23-417c-bfe4-6d920fb24b6e None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:43.293417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:43.294253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:43.294528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:43.294799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:43.301486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:43.302937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:43.316123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:43:43.317247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 628/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:43.323825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:43.436216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16f2c-dacf-437e-bfd0-4f09bf2f4408 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:43.469622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9a081-f734-4d2b-a476-d16797384b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:43.470329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a081-f734-4d2b-a476-d16797384b2d None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:43.470605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a081-f734-4d2b-a476-d16797384b2d None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:43.470871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a081-f734-4d2b-a476-d16797384b2d None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:43.471653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9a081-f734-4d2b-a476-d16797384b2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:43.471955 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9a081-f734-4d2b-a476-d16797384b2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:43.473425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9a081-f734-4d2b-a476-d16797384b2d None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:43.485177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 644/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:43.494597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:43.597156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae40a5-fb0a-4e98-acd7-0c7fe06921f0 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:43.630829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89891e-e860-4604-a45b-907751d32c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:43.631697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89891e-e860-4604-a45b-907751d32c67 None admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:43.631973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89891e-e860-4604-a45b-907751d32c67 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:43.632244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89891e-e860-4604-a45b-907751d32c67 None admin] PATH_INFO: `/v3/projects/e9194779a0f34c48a228afad50493863/users/ca33f2f8bb0a4631912f0ed51c6f8c87/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:43.634303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89891e-e860-4604-a45b-907751d32c67 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9194779a0f34c48a228afad50493863, user_id=ca33f2f8bb0a4631912f0ed51c6f8c87, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:43.635696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89891e-e860-4604-a45b-907751d32c67 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:43.650121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 629/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Mar 24 14:43:43 2022] PUT /identity/v3/projects/e9194779a0f34c48a228afad50493863/users/ca33f2f8bb0a4631912f0ed51c6f8c87/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:43:45.888388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6ba5-0381-44cf-b72c-8a751f822d52 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:45.889266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6ba5-0381-44cf-b72c-8a751f822d52 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:45.889266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e6ba5-0381-44cf-b72c-8a751f822d52 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:45.892175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 645/1274] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:45.898072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315ae67-9b53-415f-af60-39265fdb7ea1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:45.898516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315ae67-9b53-415f-af60-39265fdb7ea1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:45.898622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315ae67-9b53-415f-af60-39265fdb7ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:45.924970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7315ae67-9b53-415f-af60-39265fdb7ea1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:45.926901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7315ae67-9b53-415f-af60-39265fdb7ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:46.000540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 630/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:46.026424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e6ba5-0381-44cf-b72c-8a751f822d52 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:46.132536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e6ba5-0381-44cf-b72c-8a751f822d52 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:46.166145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:46.166866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:46.167140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:46.167408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:46.178869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 24 14:43:46.185597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 24 14:43:46.186821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 646/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Mar 24 14:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:46.196395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315ae67-9b53-415f-af60-39265fdb7ea1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:46.296567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315ae67-9b53-415f-af60-39265fdb7ea1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:46.334157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:46.334813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:46.335096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:46.335377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:46.336118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:46.336422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:46.337785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:46.345846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 631/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Mar 24 14:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:46.352462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:46.463947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ca8ce-7ea9-4743-9872-6e9db054f2f0 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:46.497599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:46.498412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:46.498691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:46.498963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:46.509600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:46.511076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:46.527339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:46.528544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 647/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:46.537862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:46.648649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941b722-a586-462d-bcb2-e394b4b071ab None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:46.682099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:46.682764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:46.683038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:46.683310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:46.684329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:46.684629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:46.685977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:46.697260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 632/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:46.703211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:46.809220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d534ef-22f2-4eb7-956b-492417805228 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:46.843073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:46.843864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:46.844144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:46.844412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:46.851980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:46.853409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:46.866945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 24 14:43:46.868115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 648/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:46.874871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:46.985403 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a8524-05ab-48f1-9263-89ac39f348be None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:47.028482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:47.029340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:47.029777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:47.030335 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:47.031739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:47.032259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:47.035233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:47.056533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 633/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Mar 24 14:43:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:47.062731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:47.172536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b91b2-09ff-4bae-80c1-954ce4c9c6ed None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:47.207244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:47.208181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:47.208618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:47.209035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:47.283439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:47.285680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:47.395675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 649/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Mar 24 14:43:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 24 14:43:47.402254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:47.514776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3de2a5-9c6d-4ac9-a0b1-da53e70d4754 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:47.547752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:47.548566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:47.548843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:47.549111 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:47.559085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:47.560501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:47.577082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 24 14:43:47.578281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 634/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:47.587654 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:47.698411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff136d-713a-40fe-95fd-55e0bc308f0e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:47.732209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:47.732854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:47.733133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:47.733403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:47.734130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:47.734440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:47.735805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:47.746839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 650/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Mar 24 14:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:47.753096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:47.852470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a30172-7639-4330-9c46-f65d4a5e2ee1 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:47.895105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:47.895887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:47.896168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:47.896445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:47.903406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:47.904831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:47.918255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING keystone.server.flask.application [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 24 14:43:47.919482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 635/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Mar 24 14:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:47.925480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:48.027045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db488a1-4ba6-4224-b6b1-677428f86795 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:48.060229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd9756-948b-4f7f-b36e-01a894539a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:48.060875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9756-948b-4f7f-b36e-01a894539a4c None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:48.061158 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9756-948b-4f7f-b36e-01a894539a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:48.061425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9756-948b-4f7f-b36e-01a894539a4c None admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:48.062242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd9756-948b-4f7f-b36e-01a894539a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:48.062547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd9756-948b-4f7f-b36e-01a894539a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:48.063968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd9756-948b-4f7f-b36e-01a894539a4c None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:48.077105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 651/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Mar 24 14:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:48.084683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:48.184001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c279fe-0344-4f1c-828c-e6a9b87fa598 None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:48.217576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5655-caf7-444f-9474-8590a8a4bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:48.218222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5655-caf7-444f-9474-8590a8a4bfbd None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:48.218499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5655-caf7-444f-9474-8590a8a4bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:48.218767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5655-caf7-444f-9474-8590a8a4bfbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:48.219582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5655-caf7-444f-9474-8590a8a4bfbd None admin] RBAC: Adding query filter params (role.id=970223ac1f3448ae9c023d0314fcbbbd, scope.project.id=e9194779a0f34c48a228afad50493863, user.id=ca33f2f8bb0a4631912f0ed51c6f8c87) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:48.219893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5655-caf7-444f-9474-8590a8a4bfbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:48.221297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5655-caf7-444f-9474-8590a8a4bfbd None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:48.226991 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 636/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Mar 24 14:43:48 2022] GET /identity/v3/role_assignments?user.id=ca33f2f8bb0a4631912f0ed51c6f8c87&scope.project.id=e9194779a0f34c48a228afad50493863&role.id=970223ac1f3448ae9c023d0314fcbbbd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:50.511721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e53d4-24f0-4f56-9f40-84e76356ffcf None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:50.512606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e53d4-24f0-4f56-9f40-84e76356ffcf None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:50.512606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e53d4-24f0-4f56-9f40-84e76356ffcf None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:50.515436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 652/1288] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:50.520820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8626a-63c9-4718-aa9a-238eea3bb605 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:50.521245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8626a-63c9-4718-aa9a-238eea3bb605 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:50.521353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8626a-63c9-4718-aa9a-238eea3bb605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:50.540772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d1a8626a-63c9-4718-aa9a-238eea3bb605 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:50.541930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d1a8626a-63c9-4718-aa9a-238eea3bb605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:50.608697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 637/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:50.631588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e53d4-24f0-4f56-9f40-84e76356ffcf None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:50.735922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e53d4-24f0-4f56-9f40-84e76356ffcf None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:50.768912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:50.769620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:50.769897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:50.770191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:50.770831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:50.772185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:50.782927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 24 14:43:50.784051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 653/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:43:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:50.793684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8626a-63c9-4718-aa9a-238eea3bb605 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:50.897577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8626a-63c9-4718-aa9a-238eea3bb605 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:50.931040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4f0c-5000-4261-b0ff-1c0134bcbe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:50.931682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4f0c-5000-4261-b0ff-1c0134bcbe2f None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:50.931956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4f0c-5000-4261-b0ff-1c0134bcbe2f None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:50.932222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4f0c-5000-4261-b0ff-1c0134bcbe2f None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:50.932924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4f0c-5000-4261-b0ff-1c0134bcbe2f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:50.933219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4f0c-5000-4261-b0ff-1c0134bcbe2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:50.935121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4f0c-5000-4261-b0ff-1c0134bcbe2f None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:50.940390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 638/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Mar 24 14:43:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:50.946387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:51.058720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec63ccd-b1db-409d-8eab-6e0390fbcf0e None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:51.092896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0722c0-c405-4377-a6aa-5310d3ebf7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:51.093557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0722c0-c405-4377-a6aa-5310d3ebf7ab None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:51.093838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0722c0-c405-4377-a6aa-5310d3ebf7ab None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:51.094135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0722c0-c405-4377-a6aa-5310d3ebf7ab None admin] PATH_INFO: `/v3/services` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:51.094838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0722c0-c405-4377-a6aa-5310d3ebf7ab None admin] RBAC: Adding query filter params (type=placement) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:51.095139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0722c0-c405-4377-a6aa-5310d3ebf7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:51.096496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0722c0-c405-4377-a6aa-5310d3ebf7ab None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:51.100803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 654/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Mar 24 14:43:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:53.353416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820b2c6-2fee-4e24-9003-2eb305672121 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:53.354333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820b2c6-2fee-4e24-9003-2eb305672121 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:53.354333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820b2c6-2fee-4e24-9003-2eb305672121 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:53.357262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 639/1293] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:53.365757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c97d-6572-4e04-a272-f28808855abe None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:53.366532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c97d-6572-4e04-a272-f28808855abe None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:53.366684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c97d-6572-4e04-a272-f28808855abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:53.388343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5f28c97d-6572-4e04-a272-f28808855abe None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:53.389516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5f28c97d-6572-4e04-a272-f28808855abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:53.469291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 655/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:53.492815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820b2c6-2fee-4e24-9003-2eb305672121 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:53.604178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820b2c6-2fee-4e24-9003-2eb305672121 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:53.637763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f487e5-33ac-4afc-adb7-e10c37ace757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:53.638442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f487e5-33ac-4afc-adb7-e10c37ace757 None admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:53.638725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f487e5-33ac-4afc-adb7-e10c37ace757 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:53.638991 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f487e5-33ac-4afc-adb7-e10c37ace757 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:53.639711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f487e5-33ac-4afc-adb7-e10c37ace757 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:53.641066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f487e5-33ac-4afc-adb7-e10c37ace757 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:53.656581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 640/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Mar 24 14:43:53 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:43:55.918417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a462af-38ad-434b-8e6d-c9c50a7fd3d8 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:55.919123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a462af-38ad-434b-8e6d-c9c50a7fd3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:55.919233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a462af-38ad-434b-8e6d-c9c50a7fd3d8 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:55.921939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 656/1296] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:55.929531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58ab93-7a99-4073-987c-281efff4769e None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:55.929994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58ab93-7a99-4073-987c-281efff4769e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:55.930086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58ab93-7a99-4073-987c-281efff4769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:55.948096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-0c58ab93-7a99-4073-987c-281efff4769e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:55.949259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0c58ab93-7a99-4073-987c-281efff4769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:56.031916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 641/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 24 14:43:56.057616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a462af-38ad-434b-8e6d-c9c50a7fd3d8 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:56.159841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a462af-38ad-434b-8e6d-c9c50a7fd3d8 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:56.193875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:56.194695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:56.194970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:56.195275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] PATH_INFO: `/v3/services/placement` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:56.195923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:56.197288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:56.208662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 24 14:43:56.209802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 657/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:43:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:56.215938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58ab93-7a99-4073-987c-281efff4769e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:56.314559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58ab93-7a99-4073-987c-281efff4769e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:56.349608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:56.350282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:56.350560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:56.350831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:56.351527 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:56.351825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:56.353184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:56.358626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 642/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Mar 24 14:43:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:56.364726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:56.479689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc3836-8aeb-4ccf-afea-aacc5900eb0b None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:56.515219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acb1a3-c0bb-44c2-ae5f-50d3dbe9dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:56.515860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acb1a3-c0bb-44c2-ae5f-50d3dbe9dffd None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:56.516144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acb1a3-c0bb-44c2-ae5f-50d3dbe9dffd None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:56.516418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acb1a3-c0bb-44c2-ae5f-50d3dbe9dffd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:56.517193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acb1a3-c0bb-44c2-ae5f-50d3dbe9dffd None admin] RBAC: Adding query filter params (interface=public, service_id=1604cf357a1f42788ecb4e495e97b334, region_id=RegionOne) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:56.517501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acb1a3-c0bb-44c2-ae5f-50d3dbe9dffd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:56.518893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acb1a3-c0bb-44c2-ae5f-50d3dbe9dffd None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:56.523946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 658/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Mar 24 14:43:56 2022] GET /identity/v3/endpoints?service_id=1604cf357a1f42788ecb4e495e97b334&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:56.529715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:56.631826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b883e8d-c535-4c12-bebb-7364722da23a None admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:56.665379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd8af9-3e1e-4903-a929-4910dc4ad962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:56.666041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8af9-3e1e-4903-a929-4910dc4ad962 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:56.666343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8af9-3e1e-4903-a929-4910dc4ad962 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:56.666617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd8af9-3e1e-4903-a929-4910dc4ad962 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:56.667302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd8af9-3e1e-4903-a929-4910dc4ad962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:56.668707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd8af9-3e1e-4903-a929-4910dc4ad962 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:56.675478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 643/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Mar 24 14:43:56 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:43:58.922136 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5c0df-0f44-48a7-b153-39a31ffa3d11 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:58.922576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5c0df-0f44-48a7-b153-39a31ffa3d11 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:58.922665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5c0df-0f44-48a7-b153-39a31ffa3d11 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:58.924509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 659/1302] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:43:58.929707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57ea5-66d5-4a1e-9780-17972f3c8dce None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:58.930180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57ea5-66d5-4a1e-9780-17972f3c8dce None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:58.930274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57ea5-66d5-4a1e-9780-17972f3c8dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:58.951784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e0f57ea5-66d5-4a1e-9780-17972f3c8dce None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:43:58.952954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e0f57ea5-66d5-4a1e-9780-17972f3c8dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:43:59.030758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 644/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:43:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 24 14:43:59.054173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5c0df-0f44-48a7-b153-39a31ffa3d11 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:59.157804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5c0df-0f44-48a7-b153-39a31ffa3d11 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:59.191117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:59.191908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:59.192181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:59.192460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:59.193106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:59.194494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:59.205996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING keystone.server.flask.application [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 24 14:43:59.207154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 660/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Mar 24 14:43:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 24 14:43:59.213455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57ea5-66d5-4a1e-9780-17972f3c8dce None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:59.307616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57ea5-66d5-4a1e-9780-17972f3c8dce None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:59.341353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53c8c-ecb5-4ffe-8e3a-f4a1be764680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:59.341988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53c8c-ecb5-4ffe-8e3a-f4a1be764680 None admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:59.342301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53c8c-ecb5-4ffe-8e3a-f4a1be764680 None admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:59.342569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53c8c-ecb5-4ffe-8e3a-f4a1be764680 None admin] PATH_INFO: `/v3/services` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:59.343267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53c8c-ecb5-4ffe-8e3a-f4a1be764680 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:43:59.343571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53c8c-ecb5-4ffe-8e3a-f4a1be764680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:59.344925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53c8c-ecb5-4ffe-8e3a-f4a1be764680 None admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:59.349997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 645/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Mar 24 14:43:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:43:59.356475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:43:59.475088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d4e9-2f51-4db7-afd2-69ae03c338f6 None admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:43:59.509172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18819a55-001d-4e9d-8433-ad7b1d66ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:43:59.509820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819a55-001d-4e9d-8433-ad7b1d66ce08 None admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:43:59.510112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819a55-001d-4e9d-8433-ad7b1d66ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:43:59.510404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819a55-001d-4e9d-8433-ad7b1d66ce08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:43:59.511143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819a55-001d-4e9d-8433-ad7b1d66ce08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:43:59.512528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819a55-001d-4e9d-8433-ad7b1d66ce08 None admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:43:59.535338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 661/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Mar 24 14:43:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:45:03.147262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae541b3-857e-44b9-812a-6ca2668f1296 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:03.147843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae541b3-857e-44b9-812a-6ca2668f1296 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:03.147843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae541b3-857e-44b9-812a-6ca2668f1296 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:03.149753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 646/1307] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:03.159035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689cf3-8a41-49d6-8ab6-28ed0ea33717 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:03.159514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689cf3-8a41-49d6-8ab6-28ed0ea33717 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:03.159514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff689cf3-8a41-49d6-8ab6-28ed0ea33717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:03.252223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ff689cf3-8a41-49d6-8ab6-28ed0ea33717 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:03.253843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ff689cf3-8a41-49d6-8ab6-28ed0ea33717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:03.400856 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 662/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:45:03.473585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692993b6-e104-467a-9cbc-8c7fc6b7412b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:03.473585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692993b6-e104-467a-9cbc-8c7fc6b7412b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:03.473585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692993b6-e104-467a-9cbc-8c7fc6b7412b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:03.475441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 647/1309] 10.222.0.43 () {54 vars in 963 bytes} [Thu Mar 24 14:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:03.482227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788fd0-2b3c-4f21-9cb2-2ec7db1b474a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:03.483013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788fd0-2b3c-4f21-9cb2-2ec7db1b474a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:03.483837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788fd0-2b3c-4f21-9cb2-2ec7db1b474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:03.608037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c5788fd0-2b3c-4f21-9cb2-2ec7db1b474a None None] MFA Rules not processed for user `750a6a7b35204c47ac16a584e7e71713`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:03.609176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c5788fd0-2b3c-4f21-9cb2-2ec7db1b474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:03.736467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 663/1310] 10.222.0.43 () {58 vars in 1060 bytes} [Thu Mar 24 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:45:03.745341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692993b6-e104-467a-9cbc-8c7fc6b7412b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:03.747413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-692993b6-e104-467a-9cbc-8c7fc6b7412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:03.870526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692993b6-e104-467a-9cbc-8c7fc6b7412b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:03.975296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089a9f7-2c5b-46d5-8f04-79c0aecc2853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:03.976485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089a9f7-2c5b-46d5-8f04-79c0aecc2853 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:03.976966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089a9f7-2c5b-46d5-8f04-79c0aecc2853 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:03.977436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089a9f7-2c5b-46d5-8f04-79c0aecc2853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:03.979497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3089a9f7-2c5b-46d5-8f04-79c0aecc2853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:04.095782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089a9f7-2c5b-46d5-8f04-79c0aecc2853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:04.097861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089a9f7-2c5b-46d5-8f04-79c0aecc2853 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:04.117950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 648/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:06.769504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdfe46-460b-489f-889b-6a34065a835c None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:06.770056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdfe46-460b-489f-889b-6a34065a835c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:06.770056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdfe46-460b-489f-889b-6a34065a835c None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:06.771838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 664/1312] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:06.777196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111b7e-fc8f-4a45-851a-f38fe536f9a1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:06.777664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111b7e-fc8f-4a45-851a-f38fe536f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:06.777756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111b7e-fc8f-4a45-851a-f38fe536f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:06.859835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-8f111b7e-fc8f-4a45-851a-f38fe536f9a1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:06.861055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8f111b7e-fc8f-4a45-851a-f38fe536f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:06.957059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 649/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:06.999692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdfe46-460b-489f-889b-6a34065a835c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:07.001616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9ffdfe46-460b-489f-889b-6a34065a835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:07.105712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdfe46-460b-489f-889b-6a34065a835c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:07.180214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f604f5-8e89-44c0-9126-052b554b0297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:07.180865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f604f5-8e89-44c0-9126-052b554b0297 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:07.181148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f604f5-8e89-44c0-9126-052b554b0297 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:07.181390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f604f5-8e89-44c0-9126-052b554b0297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:07.183057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-95f604f5-8e89-44c0-9126-052b554b0297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:07.295485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f604f5-8e89-44c0-9126-052b554b0297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:07.296939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f604f5-8e89-44c0-9126-052b554b0297 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:07.315251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 665/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:09.908062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b591d-c8c1-479d-b801-d0ccd56b683d None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:09.908801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b591d-c8c1-479d-b801-d0ccd56b683d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:09.908972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b591d-c8c1-479d-b801-d0ccd56b683d None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:09.911899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 650/1315] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:09.917265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbdec5-96c9-4d9d-8ca6-d55623909a5a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:09.917692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbdec5-96c9-4d9d-8ca6-d55623909a5a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:09.917800 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbdec5-96c9-4d9d-8ca6-d55623909a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:09.982816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-24bbdec5-96c9-4d9d-8ca6-d55623909a5a None None] MFA Rules not processed for user `de278bb29838403d8ea329a83f4047be`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:09.983997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-24bbdec5-96c9-4d9d-8ca6-d55623909a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:10.082684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 666/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:10.142402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920088-8235-45e9-9429-1ec3142be85c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:10.142665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920088-8235-45e9-9429-1ec3142be85c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:10.142967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920088-8235-45e9-9429-1ec3142be85c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:10.144754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 651/1317] 10.222.0.43 () {54 vars in 963 bytes} [Thu Mar 24 14:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:10.151799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21a02-975f-4076-b3ac-e81c632a39a7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:10.152152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21a02-975f-4076-b3ac-e81c632a39a7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:10.152569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b21a02-975f-4076-b3ac-e81c632a39a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:10.237005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e3b21a02-975f-4076-b3ac-e81c632a39a7 None None] MFA Rules not processed for user `750a6a7b35204c47ac16a584e7e71713`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:10.238229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e3b21a02-975f-4076-b3ac-e81c632a39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:10.313391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 667/1318] 10.222.0.43 () {58 vars in 1060 bytes} [Thu Mar 24 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:10.326109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920088-8235-45e9-9429-1ec3142be85c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:10.327633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5e920088-8235-45e9-9429-1ec3142be85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:10.444624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920088-8235-45e9-9429-1ec3142be85c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:10.523200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09256f-f7a5-4f51-857f-b7c32c4a86da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:10.523837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09256f-f7a5-4f51-857f-b7c32c4a86da service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:10.524111 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09256f-f7a5-4f51-857f-b7c32c4a86da service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:10.524384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09256f-f7a5-4f51-857f-b7c32c4a86da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:10.525992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ca09256f-f7a5-4f51-857f-b7c32c4a86da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:10.646626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09256f-f7a5-4f51-857f-b7c32c4a86da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:10.648048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09256f-f7a5-4f51-857f-b7c32c4a86da service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:10.665670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 652/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:13.826736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af3ed0-3dbb-4edc-b19c-f9cf10a3200f None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:13.827643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af3ed0-3dbb-4edc-b19c-f9cf10a3200f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:13.827643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af3ed0-3dbb-4edc-b19c-f9cf10a3200f None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:13.830876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 668/1320] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:13.836183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816c77-bc89-49c4-af7d-e081f4912744 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:13.836609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816c77-bc89-49c4-af7d-e081f4912744 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:13.836716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816c77-bc89-49c4-af7d-e081f4912744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:13.910526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d7816c77-bc89-49c4-af7d-e081f4912744 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:13.911730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d7816c77-bc89-49c4-af7d-e081f4912744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:14.007492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 653/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:14.047039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af3ed0-3dbb-4edc-b19c-f9cf10a3200f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:14.048556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-49af3ed0-3dbb-4edc-b19c-f9cf10a3200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:14.162324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af3ed0-3dbb-4edc-b19c-f9cf10a3200f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:14.239079 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc43da-ccbe-46fe-9340-dbc19f7c8860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:14.239724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc43da-ccbe-46fe-9340-dbc19f7c8860 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:14.240008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc43da-ccbe-46fe-9340-dbc19f7c8860 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:14.240280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc43da-ccbe-46fe-9340-dbc19f7c8860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:14.241899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c8bc43da-ccbe-46fe-9340-dbc19f7c8860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:14.354669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc43da-ccbe-46fe-9340-dbc19f7c8860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:14.356098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc43da-ccbe-46fe-9340-dbc19f7c8860 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:14.374027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 669/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:17.362816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ba00-18b9-4ba8-84e9-d11005e67ff5 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:17.363386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ba00-18b9-4ba8-84e9-d11005e67ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:17.363386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382ba00-18b9-4ba8-84e9-d11005e67ff5 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:17.365202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 654/1323] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:17.370548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed197906-2c85-4a05-8c4b-1111d82837b8 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:17.371060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed197906-2c85-4a05-8c4b-1111d82837b8 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:17.371060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed197906-2c85-4a05-8c4b-1111d82837b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:17.435213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ed197906-2c85-4a05-8c4b-1111d82837b8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:17.436419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ed197906-2c85-4a05-8c4b-1111d82837b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:17.536376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 670/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:17.572476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ba00-18b9-4ba8-84e9-d11005e67ff5 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:17.574119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0382ba00-18b9-4ba8-84e9-d11005e67ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:17.677823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382ba00-18b9-4ba8-84e9-d11005e67ff5 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:17.758737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3dbbf-1bbb-4d49-8c37-2ac851bce16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:17.759390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3dbbf-1bbb-4d49-8c37-2ac851bce16e service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:17.759671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3dbbf-1bbb-4d49-8c37-2ac851bce16e service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:17.759914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3dbbf-1bbb-4d49-8c37-2ac851bce16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:17.761612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5ad3dbbf-1bbb-4d49-8c37-2ac851bce16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:17.872516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3dbbf-1bbb-4d49-8c37-2ac851bce16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:17.873957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3dbbf-1bbb-4d49-8c37-2ac851bce16e service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:17.892173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 655/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:20.209347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552d83-3114-4ecd-affe-ceb3c6e67401 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:20.209879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552d83-3114-4ecd-affe-ceb3c6e67401 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:20.209879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552d83-3114-4ecd-affe-ceb3c6e67401 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:20.211611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 671/1326] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:20.217722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049313b-0089-46f8-88e3-8d7ff16fed7e None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:20.218177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049313b-0089-46f8-88e3-8d7ff16fed7e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:20.218433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049313b-0089-46f8-88e3-8d7ff16fed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:20.281649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-9049313b-0089-46f8-88e3-8d7ff16fed7e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:20.282874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-9049313b-0089-46f8-88e3-8d7ff16fed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:20.381091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 656/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:20.416800 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8552d83-3114-4ecd-affe-ceb3c6e67401 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:20.418394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b8552d83-3114-4ecd-affe-ceb3c6e67401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:20.527078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8552d83-3114-4ecd-affe-ceb3c6e67401 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:20.603306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871674e-46ae-4103-867c-251c48dd41f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:20.603953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871674e-46ae-4103-867c-251c48dd41f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:20.604289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871674e-46ae-4103-867c-251c48dd41f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:20.604561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871674e-46ae-4103-867c-251c48dd41f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:20.606203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6871674e-46ae-4103-867c-251c48dd41f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:20.718401 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871674e-46ae-4103-867c-251c48dd41f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:20.719841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871674e-46ae-4103-867c-251c48dd41f7 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:20.738048 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 672/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:23.048938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc610e5-4ced-4420-b2eb-0c759416724b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:23.049488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc610e5-4ced-4420-b2eb-0c759416724b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:23.049488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc610e5-4ced-4420-b2eb-0c759416724b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:23.051293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 657/1329] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:23.056693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efc8e5-9b87-4639-b067-d6b433262d76 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:23.057156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efc8e5-9b87-4639-b067-d6b433262d76 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:23.057346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efc8e5-9b87-4639-b067-d6b433262d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:23.132600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-07efc8e5-9b87-4639-b067-d6b433262d76 None None] MFA Rules not processed for user `de278bb29838403d8ea329a83f4047be`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:23.134247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-07efc8e5-9b87-4639-b067-d6b433262d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:23.232081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 673/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:23.269057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc610e5-4ced-4420-b2eb-0c759416724b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:23.270708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fbc610e5-4ced-4420-b2eb-0c759416724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:23.375107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc610e5-4ced-4420-b2eb-0c759416724b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:23.448224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51208c-2779-4c4b-824a-31dca1db36d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:23.448870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51208c-2779-4c4b-824a-31dca1db36d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:23.449149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51208c-2779-4c4b-824a-31dca1db36d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:23.449419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51208c-2779-4c4b-824a-31dca1db36d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:23.451061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fa51208c-2779-4c4b-824a-31dca1db36d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:23.560189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51208c-2779-4c4b-824a-31dca1db36d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:23.561551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51208c-2779-4c4b-824a-31dca1db36d4 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:23.580004 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 658/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:26.077342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9745df-531f-4873-8420-a5d784dc4cd4 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:26.078211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9745df-531f-4873-8420-a5d784dc4cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:26.078342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9745df-531f-4873-8420-a5d784dc4cd4 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:26.081696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 674/1332] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:26.090574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd064-9d9e-4fc2-aa1f-a30693b8454d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:26.090995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd064-9d9e-4fc2-aa1f-a30693b8454d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:26.091205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd064-9d9e-4fc2-aa1f-a30693b8454d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:26.162291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-8b8fd064-9d9e-4fc2-aa1f-a30693b8454d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:26.163411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8b8fd064-9d9e-4fc2-aa1f-a30693b8454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:26.272625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 659/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:26.309482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9745df-531f-4873-8420-a5d784dc4cd4 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:26.311046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1c9745df-531f-4873-8420-a5d784dc4cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:26.419240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9745df-531f-4873-8420-a5d784dc4cd4 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:26.491755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dc6c7-09d5-4efc-9211-bc0e641e3cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:26.492447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc6c7-09d5-4efc-9211-bc0e641e3cfa service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:26.492731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc6c7-09d5-4efc-9211-bc0e641e3cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:26.493004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dc6c7-09d5-4efc-9211-bc0e641e3cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:26.494720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3b1dc6c7-09d5-4efc-9211-bc0e641e3cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:26.604916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dc6c7-09d5-4efc-9211-bc0e641e3cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:26.606383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dc6c7-09d5-4efc-9211-bc0e641e3cfa service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:26.624260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 675/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:28.931618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49755-f751-4a78-8c6f-5e85c616cb6d None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:28.932181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49755-f751-4a78-8c6f-5e85c616cb6d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:28.932181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49755-f751-4a78-8c6f-5e85c616cb6d None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:28.934035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 660/1335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:28.939559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b39a49-9992-44d6-ae6b-b84d478ed3ec None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:28.940015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b39a49-9992-44d6-ae6b-b84d478ed3ec None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:28.940133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b39a49-9992-44d6-ae6b-b84d478ed3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:29.012628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e5b39a49-9992-44d6-ae6b-b84d478ed3ec None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:29.013851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e5b39a49-9992-44d6-ae6b-b84d478ed3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:29.113750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 676/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:29.156706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49755-f751-4a78-8c6f-5e85c616cb6d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:29.158444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0cc49755-f751-4a78-8c6f-5e85c616cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:29.261387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49755-f751-4a78-8c6f-5e85c616cb6d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:29.334801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca670997-2b2e-4560-a416-67f1d23fba65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:29.335437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca670997-2b2e-4560-a416-67f1d23fba65 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:29.335715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca670997-2b2e-4560-a416-67f1d23fba65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:29.335982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca670997-2b2e-4560-a416-67f1d23fba65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:29.337593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ca670997-2b2e-4560-a416-67f1d23fba65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:29.446345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca670997-2b2e-4560-a416-67f1d23fba65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:29.447705 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca670997-2b2e-4560-a416-67f1d23fba65 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:29.465528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 661/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:45:32.082775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57f44c-0db9-4724-82ad-db74a637aab7 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:32.083349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57f44c-0db9-4724-82ad-db74a637aab7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:32.083349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57f44c-0db9-4724-82ad-db74a637aab7 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:32.086168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 677/1338] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:32.094151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa442d-a40b-4344-b4a9-4485aba85b43 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:32.094624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa442d-a40b-4344-b4a9-4485aba85b43 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:32.094717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa442d-a40b-4344-b4a9-4485aba85b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:32.157968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-5afa442d-a40b-4344-b4a9-4485aba85b43 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:32.159099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5afa442d-a40b-4344-b4a9-4485aba85b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:32.260869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 662/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:45:32.296959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57f44c-0db9-4724-82ad-db74a637aab7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:32.298526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3b57f44c-0db9-4724-82ad-db74a637aab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:32.405448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57f44c-0db9-4724-82ad-db74a637aab7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:32.477237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c725b0-9b5a-4d45-a406-e36420c405e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:32.477892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c725b0-9b5a-4d45-a406-e36420c405e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:32.478184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c725b0-9b5a-4d45-a406-e36420c405e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:32.478482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c725b0-9b5a-4d45-a406-e36420c405e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:32.480167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a6c725b0-9b5a-4d45-a406-e36420c405e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:32.589847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c725b0-9b5a-4d45-a406-e36420c405e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:32.591319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c725b0-9b5a-4d45-a406-e36420c405e6 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:32.608244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 678/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:36.903486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd9b7-7381-49ee-9a6b-b2508c8b6dcd None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:36.903964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd9b7-7381-49ee-9a6b-b2508c8b6dcd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:36.904059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bd9b7-7381-49ee-9a6b-b2508c8b6dcd None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:36.905836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 663/1341] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:36.911221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06416901-1cab-4006-871f-9c81279a22ed None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:36.911663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06416901-1cab-4006-871f-9c81279a22ed None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:36.911902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06416901-1cab-4006-871f-9c81279a22ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:36.987074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-06416901-1cab-4006-871f-9c81279a22ed None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:36.988371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-06416901-1cab-4006-871f-9c81279a22ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:37.100087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 679/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:37.139243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd9b7-7381-49ee-9a6b-b2508c8b6dcd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:37.141808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-245bd9b7-7381-49ee-9a6b-b2508c8b6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:37.241378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bd9b7-7381-49ee-9a6b-b2508c8b6dcd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:37.245238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a3cda-1c8d-4292-b00f-6f0f9fc8e1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:37.245880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3cda-1c8d-4292-b00f-6f0f9fc8e1ee service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:37.246188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3cda-1c8d-4292-b00f-6f0f9fc8e1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:37.246472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3cda-1c8d-4292-b00f-6f0f9fc8e1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:37.255469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a3cda-1c8d-4292-b00f-6f0f9fc8e1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:37.256884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a3cda-1c8d-4292-b00f-6f0f9fc8e1ee service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:37.266126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 664/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:40.181179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2606-8261-49f8-8253-4bc4fb0769ef None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:40.181738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2606-8261-49f8-8253-4bc4fb0769ef None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:40.181738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee2606-8261-49f8-8253-4bc4fb0769ef None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:40.183559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 680/1344] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:40.189042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b371dda-8914-4710-ace1-758255946e1c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:40.189504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b371dda-8914-4710-ace1-758255946e1c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:40.189616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b371dda-8914-4710-ace1-758255946e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:40.218550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4b371dda-8914-4710-ace1-758255946e1c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:40.219742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4b371dda-8914-4710-ace1-758255946e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:40.298638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 665/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:40.335982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2606-8261-49f8-8253-4bc4fb0769ef None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:40.346923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee2606-8261-49f8-8253-4bc4fb0769ef None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:40.350665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84ed71-b4da-4606-8938-60a914610e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:40.351298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84ed71-b4da-4606-8938-60a914610e81 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:40.351571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84ed71-b4da-4606-8938-60a914610e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:40.351798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84ed71-b4da-4606-8938-60a914610e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:40.360921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84ed71-b4da-4606-8938-60a914610e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:40.362365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84ed71-b4da-4606-8938-60a914610e81 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:40.371829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 681/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:45:44.724331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbac67-47cf-43fe-a928-82542b6cc274 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:44.724910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbac67-47cf-43fe-a928-82542b6cc274 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:44.724910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbac67-47cf-43fe-a928-82542b6cc274 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:44.726694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 666/1347] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:44.732407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd499-8a5f-46fe-9b38-505063f0b796 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:44.732851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd499-8a5f-46fe-9b38-505063f0b796 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:44.732851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fd499-8a5f-46fe-9b38-505063f0b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:44.751074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-466fd499-8a5f-46fe-9b38-505063f0b796 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:44.752258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-466fd499-8a5f-46fe-9b38-505063f0b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:44.761023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 682/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:44.798767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbac67-47cf-43fe-a928-82542b6cc274 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:45:44.810639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbac67-47cf-43fe-a928-82542b6cc274 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:45:44.814602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ec7e-5368-4613-92e1-9508ef11b12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:45:44.815315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ec7e-5368-4613-92e1-9508ef11b12a service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:44.815665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ec7e-5368-4613-92e1-9508ef11b12a service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:44.816028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ec7e-5368-4613-92e1-9508ef11b12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:44.825560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ec7e-5368-4613-92e1-9508ef11b12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:45:44.827091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ec7e-5368-4613-92e1-9508ef11b12a service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:45:44.836959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 667/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:45:50.114491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5350f-1184-4265-8095-60e9ab1971e6 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:50.115418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5350f-1184-4265-8095-60e9ab1971e6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:50.115885 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5350f-1184-4265-8095-60e9ab1971e6 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:50.118294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 683/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:45:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:50.123740 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b73eb-6fad-41c2-bfe3-ea55ef43cab3 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:50.124532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b73eb-6fad-41c2-bfe3-ea55ef43cab3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:50.125027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b73eb-6fad-41c2-bfe3-ea55ef43cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:50.193571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-639b73eb-6fad-41c2-bfe3-ea55ef43cab3 None None] MFA Rules not processed for user `ca33f2f8bb0a4631912f0ed51c6f8c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:50.195030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-639b73eb-6fad-41c2-bfe3-ea55ef43cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:50.265510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 668/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:54.587093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61969cd-81f6-4cb6-885e-10ba0055d486 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:54.587686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61969cd-81f6-4cb6-885e-10ba0055d486 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:54.587686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61969cd-81f6-4cb6-885e-10ba0055d486 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:54.589724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 684/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:54.594689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306ee24-642e-4d0c-9b79-7aab46acf7ab None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:54.595095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306ee24-642e-4d0c-9b79-7aab46acf7ab None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:54.595338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306ee24-642e-4d0c-9b79-7aab46acf7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:54.613450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6306ee24-642e-4d0c-9b79-7aab46acf7ab None None] MFA Rules not processed for user `ca33f2f8bb0a4631912f0ed51c6f8c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:54.614700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6306ee24-642e-4d0c-9b79-7aab46acf7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:54.624296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 669/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:56.279681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a94bbb-8274-4766-b16d-ab942ad64944 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:56.280240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a94bbb-8274-4766-b16d-ab942ad64944 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:56.280240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a94bbb-8274-4766-b16d-ab942ad64944 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:56.281893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 685/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:56.286794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0755-f37f-4ad0-9923-3405332806ac None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:56.287242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0755-f37f-4ad0-9923-3405332806ac None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:56.287357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0755-f37f-4ad0-9923-3405332806ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:56.305050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4c9d0755-f37f-4ad0-9923-3405332806ac None None] MFA Rules not processed for user `ca33f2f8bb0a4631912f0ed51c6f8c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:56.306259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4c9d0755-f37f-4ad0-9923-3405332806ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:56.315879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 670/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:45:59.916652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f26a3-d8ff-40b3-980d-a590f99ca89a None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:59.917102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f26a3-d8ff-40b3-980d-a590f99ca89a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:59.917178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f26a3-d8ff-40b3-980d-a590f99ca89a None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:59.919107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 686/1356] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:45:59.924323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e170-b84e-4edd-87c6-a9d9f3aace42 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:45:59.925110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e170-b84e-4edd-87c6-a9d9f3aace42 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:45:59.925395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7e170-b84e-4edd-87c6-a9d9f3aace42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:45:59.943516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-23b7e170-b84e-4edd-87c6-a9d9f3aace42 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:45:59.944624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-23b7e170-b84e-4edd-87c6-a9d9f3aace42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:45:59.953013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 671/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:46:00.000444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af755787-98fc-4b0e-84a3-68983cf65b4c None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:00.000798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af755787-98fc-4b0e-84a3-68983cf65b4c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:00.001154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af755787-98fc-4b0e-84a3-68983cf65b4c None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:00.003232 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 687/1358] 10.222.0.43 () {54 vars in 960 bytes} [Thu Mar 24 14:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:00.008474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484435f-f8ab-4749-8701-92847c1a4b83 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:00.008765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484435f-f8ab-4749-8701-92847c1a4b83 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:00.009042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484435f-f8ab-4749-8701-92847c1a4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:00.055733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4484435f-f8ab-4749-8701-92847c1a4b83 None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:00.056996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4484435f-f8ab-4749-8701-92847c1a4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:00.144993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 672/1359] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Mar 24 14:46:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:00.152841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af755787-98fc-4b0e-84a3-68983cf65b4c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:00.167228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af755787-98fc-4b0e-84a3-68983cf65b4c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:00.172526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c428c-118d-4098-a51d-a73bf5b85633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:00.173454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c428c-118d-4098-a51d-a73bf5b85633 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:00.173803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c428c-118d-4098-a51d-a73bf5b85633 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:00.174186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c428c-118d-4098-a51d-a73bf5b85633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:00.183182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c428c-118d-4098-a51d-a73bf5b85633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:00.184861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c428c-118d-4098-a51d-a73bf5b85633 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:00.200714 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 688/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:02.691416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362254d-fb30-400a-9c6d-a7d322b95ffc None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:02.691980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362254d-fb30-400a-9c6d-a7d322b95ffc None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:02.691980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362254d-fb30-400a-9c6d-a7d322b95ffc None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:02.693719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 673/1361] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:02.699062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119edcb5-e9c0-4012-b659-e0f6f50ec28d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:02.699491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119edcb5-e9c0-4012-b659-e0f6f50ec28d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:02.699885 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119edcb5-e9c0-4012-b659-e0f6f50ec28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:02.717769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-119edcb5-e9c0-4012-b659-e0f6f50ec28d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:02.719094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-119edcb5-e9c0-4012-b659-e0f6f50ec28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:02.727032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 689/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:02.770998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362254d-fb30-400a-9c6d-a7d322b95ffc None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:02.785251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362254d-fb30-400a-9c6d-a7d322b95ffc None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:02.790847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d01ee5-bde8-4a1d-a185-f80535441a87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:02.791508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d01ee5-bde8-4a1d-a185-f80535441a87 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:02.791783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d01ee5-bde8-4a1d-a185-f80535441a87 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:02.792051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d01ee5-bde8-4a1d-a185-f80535441a87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:02.800050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d01ee5-bde8-4a1d-a185-f80535441a87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:02.801604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d01ee5-bde8-4a1d-a185-f80535441a87 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:02.811002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 674/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:05.387565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5dd49-ce19-49dd-ba67-f0f748780d8a None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:05.388101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5dd49-ce19-49dd-ba67-f0f748780d8a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:05.388101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5dd49-ce19-49dd-ba67-f0f748780d8a None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:05.389904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 690/1364] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:05.395040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc289284-d96a-41df-a048-b41cec6f32f0 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:05.395475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc289284-d96a-41df-a048-b41cec6f32f0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:05.395567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc289284-d96a-41df-a048-b41cec6f32f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:05.417355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-cc289284-d96a-41df-a048-b41cec6f32f0 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:05.418827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-cc289284-d96a-41df-a048-b41cec6f32f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:05.427245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 675/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:05.472901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048888d3-6e3f-4a61-93c5-6b61885ab5dd None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:05.473253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048888d3-6e3f-4a61-93c5-6b61885ab5dd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:05.473528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048888d3-6e3f-4a61-93c5-6b61885ab5dd None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:05.475571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 691/1366] 10.222.0.43 () {54 vars in 960 bytes} [Thu Mar 24 14:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:05.481161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4a90-44d5-4359-8c04-1cb07f04bca9 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:05.481449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4a90-44d5-4359-8c04-1cb07f04bca9 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:05.481720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4a90-44d5-4359-8c04-1cb07f04bca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:05.501272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-be8c4a90-44d5-4359-8c04-1cb07f04bca9 None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:05.502489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-be8c4a90-44d5-4359-8c04-1cb07f04bca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:05.512621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 676/1367] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Mar 24 14:46:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:05.520573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048888d3-6e3f-4a61-93c5-6b61885ab5dd None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:05.535130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048888d3-6e3f-4a61-93c5-6b61885ab5dd None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:05.540531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2b8f8-e223-413d-9bc8-d4178409561c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:05.541191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b8f8-e223-413d-9bc8-d4178409561c service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:05.541459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b8f8-e223-413d-9bc8-d4178409561c service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:05.541742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b8f8-e223-413d-9bc8-d4178409561c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:05.549664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2b8f8-e223-413d-9bc8-d4178409561c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:05.554929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2b8f8-e223-413d-9bc8-d4178409561c service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:05.562524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 692/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:07.947629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09baa3-2a8d-427e-b5d9-5714c107bdb5 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:07.948221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09baa3-2a8d-427e-b5d9-5714c107bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:07.948425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09baa3-2a8d-427e-b5d9-5714c107bdb5 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:07.950369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 677/1369] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:07.956078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec89548-58e4-45a6-8ec8-475a11caf1e4 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:07.956550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec89548-58e4-45a6-8ec8-475a11caf1e4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:07.956634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec89548-58e4-45a6-8ec8-475a11caf1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:07.974537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-aec89548-58e4-45a6-8ec8-475a11caf1e4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:07.975720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-aec89548-58e4-45a6-8ec8-475a11caf1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:07.983991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 693/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:08.027232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09baa3-2a8d-427e-b5d9-5714c107bdb5 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:08.041793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09baa3-2a8d-427e-b5d9-5714c107bdb5 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:08.047397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c45fc2-4900-48d8-bccd-a86c62b69ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:08.048042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c45fc2-4900-48d8-bccd-a86c62b69ff3 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:08.048284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c45fc2-4900-48d8-bccd-a86c62b69ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:08.048776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c45fc2-4900-48d8-bccd-a86c62b69ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:08.057294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c45fc2-4900-48d8-bccd-a86c62b69ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:08.058896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c45fc2-4900-48d8-bccd-a86c62b69ff3 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:08.068472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 678/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:08.081212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6f55-d44e-440b-96b9-4e732eef1ed0 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:08.081788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6f55-d44e-440b-96b9-4e732eef1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:08.082342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6f55-d44e-440b-96b9-4e732eef1ed0 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:08.084472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 694/1372] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:08.090911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9a606-cb25-4f27-b96e-c5c867680b5a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:08.091291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9a606-cb25-4f27-b96e-c5c867680b5a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:08.091655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9a606-cb25-4f27-b96e-c5c867680b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:08.110824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-78d9a606-cb25-4f27-b96e-c5c867680b5a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:08.112118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-78d9a606-cb25-4f27-b96e-c5c867680b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:08.121547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 679/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:46:08.384789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9ea60-654b-4b69-81b0-ebacdca4241a None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:08.385044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9ea60-654b-4b69-81b0-ebacdca4241a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:08.385561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9ea60-654b-4b69-81b0-ebacdca4241a None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:08.387330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 695/1374] 10.222.0.43 () {54 vars in 962 bytes} [Thu Mar 24 14:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:08.392539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bc88-ad17-46e0-b944-e1c7cf6dc3da None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:08.392795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bc88-ad17-46e0-b944-e1c7cf6dc3da None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:08.393249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108bc88-ad17-46e0-b944-e1c7cf6dc3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:08.441847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-5108bc88-ad17-46e0-b944-e1c7cf6dc3da None None] MFA Rules not processed for user `6c290be79dec4fe8b10bc04e691c00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:08.443333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5108bc88-ad17-46e0-b944-e1c7cf6dc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:08.504469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 680/1375] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Mar 24 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:08.513839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9ea60-654b-4b69-81b0-ebacdca4241a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:08.525505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9ea60-654b-4b69-81b0-ebacdca4241a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:08.529405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57ca3e-6fdc-4296-a9fe-2b64816d4efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:08.530359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ca3e-6fdc-4296-a9fe-2b64816d4efd service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:08.530883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ca3e-6fdc-4296-a9fe-2b64816d4efd service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:08.531316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ca3e-6fdc-4296-a9fe-2b64816d4efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:08.541103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57ca3e-6fdc-4296-a9fe-2b64816d4efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:08.542823 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57ca3e-6fdc-4296-a9fe-2b64816d4efd service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:08.552615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 696/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:46:10.380217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f770b-3388-483f-b0c7-ad980167dab2 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:10.380792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f770b-3388-483f-b0c7-ad980167dab2 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:10.380792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f770b-3388-483f-b0c7-ad980167dab2 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:10.382886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 681/1377] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:10.389013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83266b8-3733-4135-b64d-95adf2882a65 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:10.389557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83266b8-3733-4135-b64d-95adf2882a65 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:10.389557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83266b8-3733-4135-b64d-95adf2882a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:10.409046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a83266b8-3733-4135-b64d-95adf2882a65 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:10.410305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a83266b8-3733-4135-b64d-95adf2882a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:10.419412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 697/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:10.464316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f770b-3388-483f-b0c7-ad980167dab2 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:10.480032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f770b-3388-483f-b0c7-ad980167dab2 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:10.486432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7884-3d9f-4c81-b13f-9802d19db3f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:10.487171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7884-3d9f-4c81-b13f-9802d19db3f1 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:10.487516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7884-3d9f-4c81-b13f-9802d19db3f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:10.487876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7884-3d9f-4c81-b13f-9802d19db3f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:10.497185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7884-3d9f-4c81-b13f-9802d19db3f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:10.498841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7884-3d9f-4c81-b13f-9802d19db3f1 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:10.509207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 682/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:12.795536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc144-1952-4e50-a80f-72d9d83fd258 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:12.796116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc144-1952-4e50-a80f-72d9d83fd258 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:12.796116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebc144-1952-4e50-a80f-72d9d83fd258 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:12.797822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 698/1380] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:12.803118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ba11-9ae8-4e6b-9a4e-b865d88ae769 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:12.803553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ba11-9ae8-4e6b-9a4e-b865d88ae769 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:12.803674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ba11-9ae8-4e6b-9a4e-b865d88ae769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:12.823009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e8f2ba11-9ae8-4e6b-9a4e-b865d88ae769 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:12.824209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e8f2ba11-9ae8-4e6b-9a4e-b865d88ae769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:12.835149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 683/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:12.881018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebc144-1952-4e50-a80f-72d9d83fd258 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:12.897663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebc144-1952-4e50-a80f-72d9d83fd258 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:12.905712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317fe62-e814-44fb-bc26-3e1ca138e3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:12.906404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317fe62-e814-44fb-bc26-3e1ca138e3bc service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:12.906690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317fe62-e814-44fb-bc26-3e1ca138e3bc service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:12.906972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317fe62-e814-44fb-bc26-3e1ca138e3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:12.916726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317fe62-e814-44fb-bc26-3e1ca138e3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:12.918354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317fe62-e814-44fb-bc26-3e1ca138e3bc service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:12.928755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 699/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:15.216696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599e40-42cf-4701-9654-973f0db82e2e None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:15.217257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599e40-42cf-4701-9654-973f0db82e2e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:15.217257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f599e40-42cf-4701-9654-973f0db82e2e None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:15.219228 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 684/1383] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:15.224711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee112e-8431-4fb4-9d8e-bb79b815f13d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:15.225177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee112e-8431-4fb4-9d8e-bb79b815f13d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:15.225255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee112e-8431-4fb4-9d8e-bb79b815f13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:15.245130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-96ee112e-8431-4fb4-9d8e-bb79b815f13d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:15.246382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-96ee112e-8431-4fb4-9d8e-bb79b815f13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:15.254447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 700/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:15.295760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f599e40-42cf-4701-9654-973f0db82e2e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:15.309856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f599e40-42cf-4701-9654-973f0db82e2e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:15.315245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64449f16-3a99-448f-a73c-5f8c92d75f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:15.315973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64449f16-3a99-448f-a73c-5f8c92d75f7a service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:15.316351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64449f16-3a99-448f-a73c-5f8c92d75f7a service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:15.316800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64449f16-3a99-448f-a73c-5f8c92d75f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:15.325748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64449f16-3a99-448f-a73c-5f8c92d75f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:15.327449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64449f16-3a99-448f-a73c-5f8c92d75f7a service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:15.338190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 685/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:46:17.843632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa10e5-c4ef-44f8-953b-8733d1f62872 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:17.844192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa10e5-c4ef-44f8-953b-8733d1f62872 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:17.844192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa10e5-c4ef-44f8-953b-8733d1f62872 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:17.846010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 701/1386] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:17.852185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63ae3-8309-4949-af66-a9a78507effa None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:17.852623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63ae3-8309-4949-af66-a9a78507effa None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:17.852756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63ae3-8309-4949-af66-a9a78507effa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:17.872439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-bce63ae3-8309-4949-af66-a9a78507effa None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:17.873640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bce63ae3-8309-4949-af66-a9a78507effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:17.883642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 686/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:17.937584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa10e5-c4ef-44f8-953b-8733d1f62872 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:17.955069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa10e5-c4ef-44f8-953b-8733d1f62872 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:17.961844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be262a2c-460c-4315-8471-f6ecf7dabd69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:17.962768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262a2c-460c-4315-8471-f6ecf7dabd69 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:17.963070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262a2c-460c-4315-8471-f6ecf7dabd69 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:17.963293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be262a2c-460c-4315-8471-f6ecf7dabd69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:17.971875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262a2c-460c-4315-8471-f6ecf7dabd69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:17.973459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be262a2c-460c-4315-8471-f6ecf7dabd69 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:17.983416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 702/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:20.316591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868802b-81cc-4f18-b341-d9d781253bac None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:20.317167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868802b-81cc-4f18-b341-d9d781253bac None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:20.317337 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868802b-81cc-4f18-b341-d9d781253bac None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:20.320092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 687/1389] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:20.325592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91107a-92ec-416d-aef4-60acd98bf210 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:20.326025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91107a-92ec-416d-aef4-60acd98bf210 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:20.326176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91107a-92ec-416d-aef4-60acd98bf210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:20.346280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2b91107a-92ec-416d-aef4-60acd98bf210 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:20.347496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2b91107a-92ec-416d-aef4-60acd98bf210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:20.355959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 703/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:20.401214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868802b-81cc-4f18-b341-d9d781253bac None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:20.417404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868802b-81cc-4f18-b341-d9d781253bac None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:20.423560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa4f95-9ec9-48da-8a89-0f6d78090a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:20.424197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa4f95-9ec9-48da-8a89-0f6d78090a16 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:20.424476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa4f95-9ec9-48da-8a89-0f6d78090a16 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:20.424747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa4f95-9ec9-48da-8a89-0f6d78090a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:20.434269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa4f95-9ec9-48da-8a89-0f6d78090a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:20.436404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa4f95-9ec9-48da-8a89-0f6d78090a16 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:20.449163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 688/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:22.750663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf995ab-e977-4641-8523-6bc0f6ec8948 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:22.751273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf995ab-e977-4641-8523-6bc0f6ec8948 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:22.751273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf995ab-e977-4641-8523-6bc0f6ec8948 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:22.753046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 704/1392] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:22.758601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac28c8-f74f-4236-a558-44d5653dbe14 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:22.759068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac28c8-f74f-4236-a558-44d5653dbe14 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:22.759177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac28c8-f74f-4236-a558-44d5653dbe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:22.777898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ddac28c8-f74f-4236-a558-44d5653dbe14 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:22.779093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ddac28c8-f74f-4236-a558-44d5653dbe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:22.787489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 689/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:22.830951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf995ab-e977-4641-8523-6bc0f6ec8948 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:22.845496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf995ab-e977-4641-8523-6bc0f6ec8948 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:22.851016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54770aab-bb21-41a2-b478-eba869a39113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:22.851635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770aab-bb21-41a2-b478-eba869a39113 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:22.851962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770aab-bb21-41a2-b478-eba869a39113 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:22.852236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770aab-bb21-41a2-b478-eba869a39113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:22.860436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54770aab-bb21-41a2-b478-eba869a39113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:22.862011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54770aab-bb21-41a2-b478-eba869a39113 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:22.871951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 705/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:24.389101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92209-fe08-4345-97fe-e36b6d052b83 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:24.389710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92209-fe08-4345-97fe-e36b6d052b83 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:24.389710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92209-fe08-4345-97fe-e36b6d052b83 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:24.391449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 690/1395] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:24.396741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b597-ef11-48c1-805b-51ecde225a2d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:24.397196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b597-ef11-48c1-805b-51ecde225a2d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:24.397319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b597-ef11-48c1-805b-51ecde225a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:24.415252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d715b597-ef11-48c1-805b-51ecde225a2d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:24.416496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d715b597-ef11-48c1-805b-51ecde225a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:24.424663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 706/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:24.480978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b679d38-dbff-417c-8cb8-b5dc61ae8d5d None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:24.481268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b679d38-dbff-417c-8cb8-b5dc61ae8d5d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:24.481547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b679d38-dbff-417c-8cb8-b5dc61ae8d5d None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:24.483353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 691/1397] 10.222.0.43 () {54 vars in 961 bytes} [Thu Mar 24 14:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:24.488286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480a76-dbc0-4117-9f22-301a05f22641 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:24.488607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480a76-dbc0-4117-9f22-301a05f22641 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:24.488862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480a76-dbc0-4117-9f22-301a05f22641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:24.534809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-55480a76-dbc0-4117-9f22-301a05f22641 None None] MFA Rules not processed for user `9c6a3dbc0cbe4acc81a8691fc85c7352`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:24.535979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-55480a76-dbc0-4117-9f22-301a05f22641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:24.594392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 707/1398] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Mar 24 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:24.601935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b679d38-dbff-417c-8cb8-b5dc61ae8d5d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:24.613014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b679d38-dbff-417c-8cb8-b5dc61ae8d5d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:24.616823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b6bf4-9c04-4adf-b889-e924c5cc218b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:24.617452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6bf4-9c04-4adf-b889-e924c5cc218b service glance] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:24.617729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6bf4-9c04-4adf-b889-e924c5cc218b service glance] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:24.618001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b6bf4-9c04-4adf-b889-e924c5cc218b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:24.626763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b6bf4-9c04-4adf-b889-e924c5cc218b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:24.628182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b6bf4-9c04-4adf-b889-e924c5cc218b service glance] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:24.637590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 692/1399] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:25.064730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3931-0e7d-41a5-a30e-f1781d85a183 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:25.065019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3931-0e7d-41a5-a30e-f1781d85a183 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:25.065296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3931-0e7d-41a5-a30e-f1781d85a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:25.117053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c25c3931-0e7d-41a5-a30e-f1781d85a183 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:25.118280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c25c3931-0e7d-41a5-a30e-f1781d85a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:25.143182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c834a8-bb49-4069-8e63-b997aac3565a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:25.143471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c834a8-bb49-4069-8e63-b997aac3565a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:25.143774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c834a8-bb49-4069-8e63-b997aac3565a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:25.145558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 693/1400] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:25.150598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff678d-e463-4bd8-b9c8-f2cc81d09c84 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:25.150936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff678d-e463-4bd8-b9c8-f2cc81d09c84 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:25.151188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff678d-e463-4bd8-b9c8-f2cc81d09c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:25.169841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2dff678d-e463-4bd8-b9c8-f2cc81d09c84 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:25.171069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2dff678d-e463-4bd8-b9c8-f2cc81d09c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:25.180063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 694/1401] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:25.183289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 708/1402] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:25.223994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81832-6705-43f2-9592-2335e810e05d None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:25.224366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81832-6705-43f2-9592-2335e810e05d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:25.224499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c3931-0e7d-41a5-a30e-f1781d85a183 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:25.224770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab81832-6705-43f2-9592-2335e810e05d None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:25.226709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 695/1403] 10.222.0.43 () {54 vars in 942 bytes} [Thu Mar 24 14:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:25.232582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95687e3d-4692-4421-8488-d0a6882f7592 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:25.232897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95687e3d-4692-4421-8488-d0a6882f7592 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:25.233238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95687e3d-4692-4421-8488-d0a6882f7592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:25.236808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c3931-0e7d-41a5-a30e-f1781d85a183 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:25.242028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:25.242716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:25.242994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:25.243263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:25.251249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:25.252814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:25.262131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 709/1404] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:46:25.283807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-95687e3d-4692-4421-8488-d0a6882f7592 None None] MFA Rules not processed for user `58d77195060b4aeb8a9bfcef2dd147fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:25.285021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-95687e3d-4692-4421-8488-d0a6882f7592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:25.358508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 696/1405] 10.222.0.43 () {58 vars in 1039 bytes} [Thu Mar 24 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:46:25.368120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:25.379530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5654a-29db-4078-b298-f481b40a7c6c service nova] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:25.388924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d72a5d-62fd-4280-8708-e7419fd5ac69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:25.389606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d72a5d-62fd-4280-8708-e7419fd5ac69 service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:25.389904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d72a5d-62fd-4280-8708-e7419fd5ac69 service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:25.390194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d72a5d-62fd-4280-8708-e7419fd5ac69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:25.400397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d72a5d-62fd-4280-8708-e7419fd5ac69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:25.402015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d72a5d-62fd-4280-8708-e7419fd5ac69 service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:25.411713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 710/1406] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:46:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:46:27.597979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38024-4d6a-46e1-9af4-a3685fd1a610 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:27.598571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38024-4d6a-46e1-9af4-a3685fd1a610 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:27.598571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38024-4d6a-46e1-9af4-a3685fd1a610 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:27.600400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 697/1407] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:27.606187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e1d1-f331-488e-931f-193848d16591 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:27.606668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e1d1-f331-488e-931f-193848d16591 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:27.606761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e1d1-f331-488e-931f-193848d16591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:27.624474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1cf2e1d1-f331-488e-931f-193848d16591 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:27.625663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1cf2e1d1-f331-488e-931f-193848d16591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:27.635669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 711/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:27.679442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38024-4d6a-46e1-9af4-a3685fd1a610 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:27.694338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38024-4d6a-46e1-9af4-a3685fd1a610 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:27.701764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceb585-8d3a-4506-a372-9ce8368d89a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:27.702450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceb585-8d3a-4506-a372-9ce8368d89a9 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:27.702743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceb585-8d3a-4506-a372-9ce8368d89a9 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:27.703013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceb585-8d3a-4506-a372-9ce8368d89a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:27.712014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ceb585-8d3a-4506-a372-9ce8368d89a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:27.713690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ceb585-8d3a-4506-a372-9ce8368d89a9 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:27.723565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 698/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:48.732517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91e60b-7def-410e-bbda-904bda0f1900 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:48.733178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91e60b-7def-410e-bbda-904bda0f1900 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:48.733178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91e60b-7def-410e-bbda-904bda0f1900 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:48.734891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 712/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Mar 24 14:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:48.740243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb9d3-119a-4506-a8fe-d9915e679732 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:48.740738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb9d3-119a-4506-a8fe-d9915e679732 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:48.740738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb9d3-119a-4506-a8fe-d9915e679732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:48.760137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-07cfb9d3-119a-4506-a8fe-d9915e679732 None None] MFA Rules not processed for user `ca33f2f8bb0a4631912f0ed51c6f8c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:48.761315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-07cfb9d3-119a-4506-a8fe-d9915e679732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:48.771794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 699/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Mar 24 14:46:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:48.786353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6de6-1589-4caa-a06f-0f050c0d0a74 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:48.786636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6de6-1589-4caa-a06f-0f050c0d0a74 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:48.786917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b6de6-1589-4caa-a06f-0f050c0d0a74 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:48.788654 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 713/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Mar 24 14:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:48.793259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6b83-57e5-4686-8191-59fc71d8d9da None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:48.793540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6b83-57e5-4686-8191-59fc71d8d9da None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:48.793807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f6b83-57e5-4686-8191-59fc71d8d9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:48.812261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-615f6b83-57e5-4686-8191-59fc71d8d9da None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:48.813413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-615f6b83-57e5-4686-8191-59fc71d8d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:48.823265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 700/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Mar 24 14:46:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:46:51.561301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978a1f-593b-4517-a45c-45378f230b6f None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:51.562170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978a1f-593b-4517-a45c-45378f230b6f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:51.562170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978a1f-593b-4517-a45c-45378f230b6f None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:51.564948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:46:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:51.571076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c24cd-b62c-44b1-a822-dd8e27472d47 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:51.571590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c24cd-b62c-44b1-a822-dd8e27472d47 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:51.571732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c24cd-b62c-44b1-a822-dd8e27472d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:51.591221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b17c24cd-b62c-44b1-a822-dd8e27472d47 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:51.592432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b17c24cd-b62c-44b1-a822-dd8e27472d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:51.600804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:51.642970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978a1f-593b-4517-a45c-45378f230b6f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:51.658075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978a1f-593b-4517-a45c-45378f230b6f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:51.663788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3600bf3-4185-4df2-879c-e18c6de40414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:51.664417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600bf3-4185-4df2-879c-e18c6de40414 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:51.664691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600bf3-4185-4df2-879c-e18c6de40414 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:51.664958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600bf3-4185-4df2-879c-e18c6de40414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:51.673432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3600bf3-4185-4df2-879c-e18c6de40414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:51.675077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3600bf3-4185-4df2-879c-e18c6de40414 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:51.684757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 715/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:53.024862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f73f1-08b6-4b55-9bbe-c7e8d6b550c0 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:53.025419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f73f1-08b6-4b55-9bbe-c7e8d6b550c0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:53.025419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f73f1-08b6-4b55-9bbe-c7e8d6b550c0 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:53.027177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:53.033315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ff71-422b-41c5-b9ee-ce94855aec43 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:53.033995 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ff71-422b-41c5-b9ee-ce94855aec43 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:53.034329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ff71-422b-41c5-b9ee-ce94855aec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:53.055417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3001ff71-422b-41c5-b9ee-ce94855aec43 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:53.056598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3001ff71-422b-41c5-b9ee-ce94855aec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:53.064835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:53.236197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f73f1-08b6-4b55-9bbe-c7e8d6b550c0 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:53.253465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f73f1-08b6-4b55-9bbe-c7e8d6b550c0 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:53.259723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fa618-54e8-4ca3-becf-cdb9b576a0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:53.260357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fa618-54e8-4ca3-becf-cdb9b576a0fb service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:53.260637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fa618-54e8-4ca3-becf-cdb9b576a0fb service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:53.260909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fa618-54e8-4ca3-becf-cdb9b576a0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:53.268885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fa618-54e8-4ca3-becf-cdb9b576a0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:53.270487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fa618-54e8-4ca3-becf-cdb9b576a0fb service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:53.279605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 703/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:54.577516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3af5c1-fdfa-4d1c-ae77-b022d1af85f7 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:54.578505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3af5c1-fdfa-4d1c-ae77-b022d1af85f7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:54.578505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3af5c1-fdfa-4d1c-ae77-b022d1af85f7 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:54.581626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:46:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:54.587494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5af0-5445-4444-b930-e9ce66a6eba6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:54.588157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5af0-5445-4444-b930-e9ce66a6eba6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:54.588341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5af0-5445-4444-b930-e9ce66a6eba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:54.612006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d63b5af0-5445-4444-b930-e9ce66a6eba6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:54.613189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d63b5af0-5445-4444-b930-e9ce66a6eba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:54.622036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:54.776541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3af5c1-fdfa-4d1c-ae77-b022d1af85f7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:54.800928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3af5c1-fdfa-4d1c-ae77-b022d1af85f7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:54.809394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216b9ef-e1e6-44af-8d8f-bc7a42ae47ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:54.810029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216b9ef-e1e6-44af-8d8f-bc7a42ae47ff service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:54.810332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216b9ef-e1e6-44af-8d8f-bc7a42ae47ff service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:54.810598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216b9ef-e1e6-44af-8d8f-bc7a42ae47ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:54.819221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216b9ef-e1e6-44af-8d8f-bc7a42ae47ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:54.820790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216b9ef-e1e6-44af-8d8f-bc7a42ae47ff service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:54.830849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 718/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:56.114924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8be4e-b68e-4328-9428-f052dfcaea02 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:56.115832 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8be4e-b68e-4328-9428-f052dfcaea02 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:56.115832 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8be4e-b68e-4328-9428-f052dfcaea02 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:56.118884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:46:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:56.124835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc63149-71a5-4fe5-95dc-92ba94dd177b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:56.125552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc63149-71a5-4fe5-95dc-92ba94dd177b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:56.125699 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc63149-71a5-4fe5-95dc-92ba94dd177b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:56.148637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8fc63149-71a5-4fe5-95dc-92ba94dd177b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:56.149832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8fc63149-71a5-4fe5-95dc-92ba94dd177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:56.159254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:56.308417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8be4e-b68e-4328-9428-f052dfcaea02 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:56.325135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8be4e-b68e-4328-9428-f052dfcaea02 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:56.331928 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069d399-2869-4d71-a63d-0402035e315e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:56.332564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d399-2869-4d71-a63d-0402035e315e service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:56.332844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d399-2869-4d71-a63d-0402035e315e service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:56.333117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d399-2869-4d71-a63d-0402035e315e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:56.341413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d399-2869-4d71-a63d-0402035e315e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:56.343023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d399-2869-4d71-a63d-0402035e315e service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:56.352621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 706/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:57.639397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37db0-9c51-4c3f-83d4-1efea5704f98 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:57.640295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37db0-9c51-4c3f-83d4-1efea5704f98 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:57.640295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af37db0-9c51-4c3f-83d4-1efea5704f98 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:57.643241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:46:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:57.649320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa432-92a7-41c3-ae3c-5bfc0a103036 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:57.650144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa432-92a7-41c3-ae3c-5bfc0a103036 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:57.650329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa432-92a7-41c3-ae3c-5bfc0a103036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:57.670798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f84aa432-92a7-41c3-ae3c-5bfc0a103036 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:57.671969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f84aa432-92a7-41c3-ae3c-5bfc0a103036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:57.682165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:57.839578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37db0-9c51-4c3f-83d4-1efea5704f98 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:57.861563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af37db0-9c51-4c3f-83d4-1efea5704f98 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:57.868671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d2bc-6416-43eb-869c-89740cd41218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:57.869407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d2bc-6416-43eb-869c-89740cd41218 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:57.869585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d2bc-6416-43eb-869c-89740cd41218 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:57.869874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d2bc-6416-43eb-869c-89740cd41218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:57.878771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d2bc-6416-43eb-869c-89740cd41218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:57.880354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d2bc-6416-43eb-869c-89740cd41218 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:57.889888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 721/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:46:59.116840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2389-9e05-446f-9fbb-a60f2e146b8c None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:59.117745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2389-9e05-446f-9fbb-a60f2e146b8c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:59.117745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2389-9e05-446f-9fbb-a60f2e146b8c None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:59.120560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:46:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:46:59.128781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1fab-8941-4f0e-806a-1ea009a90194 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:59.129220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1fab-8941-4f0e-806a-1ea009a90194 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:59.129370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca1fab-8941-4f0e-806a-1ea009a90194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:59.149855 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b9ca1fab-8941-4f0e-806a-1ea009a90194 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:46:59.151098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b9ca1fab-8941-4f0e-806a-1ea009a90194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:46:59.160456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:46:59.313690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2389-9e05-446f-9fbb-a60f2e146b8c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:46:59.338030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2389-9e05-446f-9fbb-a60f2e146b8c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:46:59.345022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835142-bd7c-42a5-a091-16dd754ffbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:46:59.345658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835142-bd7c-42a5-a091-16dd754ffbc9 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:46:59.345937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835142-bd7c-42a5-a091-16dd754ffbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:46:59.346238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835142-bd7c-42a5-a091-16dd754ffbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:46:59.354502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78835142-bd7c-42a5-a091-16dd754ffbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:46:59.356072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78835142-bd7c-42a5-a091-16dd754ffbc9 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:46:59.365423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 709/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:00.603067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61730b-828e-47c3-9a27-00cf012d0c24 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:00.603649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61730b-828e-47c3-9a27-00cf012d0c24 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:00.603649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61730b-828e-47c3-9a27-00cf012d0c24 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:00.605446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:00.611568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22a468-7427-479b-8a78-465462b058b6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:00.612051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22a468-7427-479b-8a78-465462b058b6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:00.612163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22a468-7427-479b-8a78-465462b058b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:00.639121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ec22a468-7427-479b-8a78-465462b058b6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:00.640308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ec22a468-7427-479b-8a78-465462b058b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:00.648244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:00.798493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61730b-828e-47c3-9a27-00cf012d0c24 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:00.819593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61730b-828e-47c3-9a27-00cf012d0c24 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:00.829933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff905ee-e6d5-4160-acfd-f59ffdfa6f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:00.830874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff905ee-e6d5-4160-acfd-f59ffdfa6f5c service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:00.831217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff905ee-e6d5-4160-acfd-f59ffdfa6f5c service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:00.831545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff905ee-e6d5-4160-acfd-f59ffdfa6f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:00.842056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff905ee-e6d5-4160-acfd-f59ffdfa6f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:00.843672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff905ee-e6d5-4160-acfd-f59ffdfa6f5c service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:00.853573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 724/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:02.077224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca9c8-70e6-49d4-8a4a-fb85d9dca08f None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:02.078132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca9c8-70e6-49d4-8a4a-fb85d9dca08f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:02.078132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca9c8-70e6-49d4-8a4a-fb85d9dca08f None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:02.081341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:47:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:02.086474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86816f1a-eb8c-469b-b39f-2d7a57421026 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:02.086898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86816f1a-eb8c-469b-b39f-2d7a57421026 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:02.087013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86816f1a-eb8c-469b-b39f-2d7a57421026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:02.106620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-86816f1a-eb8c-469b-b39f-2d7a57421026 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:02.107779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-86816f1a-eb8c-469b-b39f-2d7a57421026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:02.115953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:02.266023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca9c8-70e6-49d4-8a4a-fb85d9dca08f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:02.284709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca9c8-70e6-49d4-8a4a-fb85d9dca08f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:02.291410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0faeb-f689-47d9-be83-498a12cfa055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:02.292037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0faeb-f689-47d9-be83-498a12cfa055 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:02.292320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0faeb-f689-47d9-be83-498a12cfa055 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:02.292588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0faeb-f689-47d9-be83-498a12cfa055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:02.300558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0faeb-f689-47d9-be83-498a12cfa055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:02.302109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0faeb-f689-47d9-be83-498a12cfa055 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:02.313985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 712/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:03.548809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0017-cf3b-444a-9613-a53a6530719a None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:03.549629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0017-cf3b-444a-9613-a53a6530719a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:03.549629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0017-cf3b-444a-9613-a53a6530719a None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:03.552442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:47:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:03.558522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356c30-f97a-4374-b169-96e01abe7d3d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:03.558984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356c30-f97a-4374-b169-96e01abe7d3d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:03.559122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356c30-f97a-4374-b169-96e01abe7d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:03.583230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e3356c30-f97a-4374-b169-96e01abe7d3d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:03.584423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e3356c30-f97a-4374-b169-96e01abe7d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:03.593451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:03.746327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d0017-cf3b-444a-9613-a53a6530719a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:03.770067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d0017-cf3b-444a-9613-a53a6530719a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:03.776815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414d71b-44f7-4682-a8c7-cb4f8df51818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:03.777509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d71b-44f7-4682-a8c7-cb4f8df51818 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:03.777767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d71b-44f7-4682-a8c7-cb4f8df51818 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:03.778042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d71b-44f7-4682-a8c7-cb4f8df51818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:03.786777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414d71b-44f7-4682-a8c7-cb4f8df51818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:03.788390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414d71b-44f7-4682-a8c7-cb4f8df51818 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:03.798270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 727/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:05.968330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da202fd-3d28-4bd2-99bb-db235bd481d3 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:05.968917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da202fd-3d28-4bd2-99bb-db235bd481d3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:05.968917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da202fd-3d28-4bd2-99bb-db235bd481d3 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:05.970709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:05.976193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739665d9-e0ca-405f-9dd6-3a612f99e810 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:05.976637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739665d9-e0ca-405f-9dd6-3a612f99e810 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:05.976740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739665d9-e0ca-405f-9dd6-3a612f99e810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:05.996287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-739665d9-e0ca-405f-9dd6-3a612f99e810 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:05.997471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-739665d9-e0ca-405f-9dd6-3a612f99e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:06.005728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:06.045119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da202fd-3d28-4bd2-99bb-db235bd481d3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:06.056386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da202fd-3d28-4bd2-99bb-db235bd481d3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:06.060230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc342c7c-5e16-4237-9a66-138b48a70b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:06.060860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc342c7c-5e16-4237-9a66-138b48a70b56 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:06.061141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc342c7c-5e16-4237-9a66-138b48a70b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:06.061413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc342c7c-5e16-4237-9a66-138b48a70b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:06.070252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc342c7c-5e16-4237-9a66-138b48a70b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:06.071729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc342c7c-5e16-4237-9a66-138b48a70b56 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:06.081208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 715/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:08.497655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad551-d5ab-4ee6-814e-aee072bb4af1 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:08.498249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad551-d5ab-4ee6-814e-aee072bb4af1 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:08.498249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad551-d5ab-4ee6-814e-aee072bb4af1 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:08.500068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:08.505612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9270-ece9-4d72-af41-b729f7a8d9ea None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:08.506125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9270-ece9-4d72-af41-b729f7a8d9ea None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:08.506221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be9270-ece9-4d72-af41-b729f7a8d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:08.525744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-72be9270-ece9-4d72-af41-b729f7a8d9ea None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:08.526962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-72be9270-ece9-4d72-af41-b729f7a8d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:08.536216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:08.574691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfad551-d5ab-4ee6-814e-aee072bb4af1 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:08.589313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfad551-d5ab-4ee6-814e-aee072bb4af1 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:08.593493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c8dae-0cbf-4de5-a21d-7e5a66976dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:08.594116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8dae-0cbf-4de5-a21d-7e5a66976dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:08.594438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8dae-0cbf-4de5-a21d-7e5a66976dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:08.594710 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8dae-0cbf-4de5-a21d-7e5a66976dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:08.607064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c8dae-0cbf-4de5-a21d-7e5a66976dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:08.608498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c8dae-0cbf-4de5-a21d-7e5a66976dc9 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:08.617948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 730/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:11.192777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ed6ee-96f0-4a86-8064-89beec037163 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:11.193671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ed6ee-96f0-4a86-8064-89beec037163 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:11.193671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ed6ee-96f0-4a86-8064-89beec037163 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:11.196523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:11.205692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e84a-8de8-490b-830c-1261f6c86a64 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:11.206064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e84a-8de8-490b-830c-1261f6c86a64 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:11.206064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737e84a-8de8-490b-830c-1261f6c86a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:11.226071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b737e84a-8de8-490b-830c-1261f6c86a64 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:11.227285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b737e84a-8de8-490b-830c-1261f6c86a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:11.236658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:11.274300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ed6ee-96f0-4a86-8064-89beec037163 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:11.285686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ed6ee-96f0-4a86-8064-89beec037163 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:11.289773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eca4c-c613-4c6c-8559-e07f042cbfe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:11.290467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eca4c-c613-4c6c-8559-e07f042cbfe9 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:11.290742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eca4c-c613-4c6c-8559-e07f042cbfe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:11.291013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eca4c-c613-4c6c-8559-e07f042cbfe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:11.300210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eca4c-c613-4c6c-8559-e07f042cbfe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:11.301626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eca4c-c613-4c6c-8559-e07f042cbfe9 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:11.313820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 718/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:13.706893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7f7f-5b6d-437f-87fe-32c3f7669e0e None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:13.707779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7f7f-5b6d-437f-87fe-32c3f7669e0e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:13.707779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7f7f-5b6d-437f-87fe-32c3f7669e0e None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:13.710674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:13.716497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66165-01e8-4a6e-8ff7-d6fdfab39240 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:13.716923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66165-01e8-4a6e-8ff7-d6fdfab39240 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:13.717012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66165-01e8-4a6e-8ff7-d6fdfab39240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:13.736309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c7f66165-01e8-4a6e-8ff7-d6fdfab39240 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:13.737510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c7f66165-01e8-4a6e-8ff7-d6fdfab39240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:13.747584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:13.788708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7f7f-5b6d-437f-87fe-32c3f7669e0e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:13.803523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7f7f-5b6d-437f-87fe-32c3f7669e0e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:13.808473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dafc1b-f889-4ae8-833b-be18ad577899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:13.809138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dafc1b-f889-4ae8-833b-be18ad577899 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:13.809412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dafc1b-f889-4ae8-833b-be18ad577899 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:13.809694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dafc1b-f889-4ae8-833b-be18ad577899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:13.819313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dafc1b-f889-4ae8-833b-be18ad577899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:13.820764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dafc1b-f889-4ae8-833b-be18ad577899 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:13.830849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 733/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:16.144707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eb896-9d65-4d4e-8e64-789470b81727 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:16.145611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eb896-9d65-4d4e-8e64-789470b81727 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:16.145611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eb896-9d65-4d4e-8e64-789470b81727 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:16.148315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:47:16.154891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5c90-4477-4c29-8470-35cecc6add8d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:16.155305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5c90-4477-4c29-8470-35cecc6add8d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:16.155404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5c90-4477-4c29-8470-35cecc6add8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:16.176239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-04dc5c90-4477-4c29-8470-35cecc6add8d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:16.177422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-04dc5c90-4477-4c29-8470-35cecc6add8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:16.186411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:16.226971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942eb896-9d65-4d4e-8e64-789470b81727 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:16.239934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942eb896-9d65-4d4e-8e64-789470b81727 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:16.244625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e899-9655-4176-b24e-6ccb421ed461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:16.245280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e899-9655-4176-b24e-6ccb421ed461 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:16.245567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e899-9655-4176-b24e-6ccb421ed461 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:16.245864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e899-9655-4176-b24e-6ccb421ed461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:16.255658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347e899-9655-4176-b24e-6ccb421ed461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:16.257089 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347e899-9655-4176-b24e-6ccb421ed461 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:16.266560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 721/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:18.568212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3d65-e5aa-4d5b-a0c1-624cb8839465 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:18.568837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3d65-e5aa-4d5b-a0c1-624cb8839465 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:18.568837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3d65-e5aa-4d5b-a0c1-624cb8839465 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:18.570632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:18.576316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531004-4497-417a-8247-20df173dee6c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:18.576765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531004-4497-417a-8247-20df173dee6c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:18.576892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531004-4497-417a-8247-20df173dee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:18.601595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3f531004-4497-417a-8247-20df173dee6c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:18.603223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3f531004-4497-417a-8247-20df173dee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:18.611578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:18.650946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e3d65-e5aa-4d5b-a0c1-624cb8839465 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:18.663911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e3d65-e5aa-4d5b-a0c1-624cb8839465 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:18.668257 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56101a5-5c19-4116-8d7e-20ae8d1f7b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:18.668888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56101a5-5c19-4116-8d7e-20ae8d1f7b4d service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:18.669168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56101a5-5c19-4116-8d7e-20ae8d1f7b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:18.669440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56101a5-5c19-4116-8d7e-20ae8d1f7b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:18.678537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56101a5-5c19-4116-8d7e-20ae8d1f7b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:18.679952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56101a5-5c19-4116-8d7e-20ae8d1f7b4d service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:18.689374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 736/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:21.047888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c97d9-d7c1-47e6-87ad-33cdca674043 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:21.048514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c97d9-d7c1-47e6-87ad-33cdca674043 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:21.048514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c97d9-d7c1-47e6-87ad-33cdca674043 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:21.050950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:21.057992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5dd0-b427-43dc-83ee-19f593abc0ab None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:21.058434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5dd0-b427-43dc-83ee-19f593abc0ab None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:21.058580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f5dd0-b427-43dc-83ee-19f593abc0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:21.077464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3e6f5dd0-b427-43dc-83ee-19f593abc0ab None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:21.078693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3e6f5dd0-b427-43dc-83ee-19f593abc0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:21.088312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:21.136057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c97d9-d7c1-47e6-87ad-33cdca674043 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:21.148528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c97d9-d7c1-47e6-87ad-33cdca674043 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:21.153198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885463-842a-4e55-881b-cce3e5e8c4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:21.153772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885463-842a-4e55-881b-cce3e5e8c4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:21.154054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885463-842a-4e55-881b-cce3e5e8c4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:21.154366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885463-842a-4e55-881b-cce3e5e8c4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:21.165815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35885463-842a-4e55-881b-cce3e5e8c4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:21.167723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35885463-842a-4e55-881b-cce3e5e8c4f1 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:21.181918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 724/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:23.589178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7ddbc-ec93-4cd7-8c50-61513f858423 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:23.589749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7ddbc-ec93-4cd7-8c50-61513f858423 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:23.589749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7ddbc-ec93-4cd7-8c50-61513f858423 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:23.591550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:23.599776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075388-e1a9-4edb-89ac-bdae449a56fd None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:23.600511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075388-e1a9-4edb-89ac-bdae449a56fd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:23.600645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075388-e1a9-4edb-89ac-bdae449a56fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:23.620173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d2075388-e1a9-4edb-89ac-bdae449a56fd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:23.621326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d2075388-e1a9-4edb-89ac-bdae449a56fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:23.630432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:23.668773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7ddbc-ec93-4cd7-8c50-61513f858423 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:23.687402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7ddbc-ec93-4cd7-8c50-61513f858423 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:23.694515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4589-4b41-4ab7-9bbc-d50dc5079fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:23.695405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4589-4b41-4ab7-9bbc-d50dc5079fae service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:23.695791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4589-4b41-4ab7-9bbc-d50dc5079fae service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:23.696094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4589-4b41-4ab7-9bbc-d50dc5079fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:23.706326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4589-4b41-4ab7-9bbc-d50dc5079fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:23.707755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4589-4b41-4ab7-9bbc-d50dc5079fae service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:23.717107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 739/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:25.975297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6930-d36b-4488-b70b-47b2e88dd1fd None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:25.975872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6930-d36b-4488-b70b-47b2e88dd1fd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:25.975872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6930-d36b-4488-b70b-47b2e88dd1fd None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:25.977697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:25.984376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3dc2-0335-44f9-a8c7-e3813ec16863 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:25.984903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3dc2-0335-44f9-a8c7-e3813ec16863 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:25.985313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa3dc2-0335-44f9-a8c7-e3813ec16863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:26.011852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8ffa3dc2-0335-44f9-a8c7-e3813ec16863 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:26.013055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8ffa3dc2-0335-44f9-a8c7-e3813ec16863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:26.023202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:26.060342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6930-d36b-4488-b70b-47b2e88dd1fd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:26.072803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6930-d36b-4488-b70b-47b2e88dd1fd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:26.077168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb8ad8-b858-4380-94e7-e71cfcff832a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:26.077791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb8ad8-b858-4380-94e7-e71cfcff832a service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:26.078067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb8ad8-b858-4380-94e7-e71cfcff832a service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:26.078363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb8ad8-b858-4380-94e7-e71cfcff832a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:26.088635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb8ad8-b858-4380-94e7-e71cfcff832a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:26.090049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb8ad8-b858-4380-94e7-e71cfcff832a service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:26.100048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 727/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:47:28.359120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f5fa-55b5-4580-9bc9-e8d9e993cbfb None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:28.359999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f5fa-55b5-4580-9bc9-e8d9e993cbfb None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:28.359999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f5fa-55b5-4580-9bc9-e8d9e993cbfb None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:28.362853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:47:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:28.371693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e49d96-d4d8-4a5d-a132-5317016849a6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:28.372134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e49d96-d4d8-4a5d-a132-5317016849a6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:28.372250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e49d96-d4d8-4a5d-a132-5317016849a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:28.392900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-88e49d96-d4d8-4a5d-a132-5317016849a6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:28.394103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-88e49d96-d4d8-4a5d-a132-5317016849a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:28.402351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:28.441826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45f5fa-55b5-4580-9bc9-e8d9e993cbfb None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:28.455768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45f5fa-55b5-4580-9bc9-e8d9e993cbfb None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:28.460483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43799475-9d4b-4a08-861d-af8ec4cbea85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:28.461128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799475-9d4b-4a08-861d-af8ec4cbea85 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:28.461466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799475-9d4b-4a08-861d-af8ec4cbea85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:28.461724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43799475-9d4b-4a08-861d-af8ec4cbea85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:28.471034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43799475-9d4b-4a08-861d-af8ec4cbea85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:28.472447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43799475-9d4b-4a08-861d-af8ec4cbea85 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:28.481819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 742/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:48.667198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8a763-f65a-463c-aed5-2dc7e1a5aa94 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:48.667831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8a763-f65a-463c-aed5-2dc7e1a5aa94 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:48.667831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8a763-f65a-463c-aed5-2dc7e1a5aa94 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:48.669492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 729/1471] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:48.674820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9280d0-ef75-4b1c-aee9-9ca5a86692e2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:48.675264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9280d0-ef75-4b1c-aee9-9ca5a86692e2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:48.675366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9280d0-ef75-4b1c-aee9-9ca5a86692e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:48.694590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9b9280d0-ef75-4b1c-aee9-9ca5a86692e2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:48.695765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9b9280d0-ef75-4b1c-aee9-9ca5a86692e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:48.703968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 743/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:48.756513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119047-3990-469b-ae9b-5b73008c8229 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:48.756860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119047-3990-469b-ae9b-5b73008c8229 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:48.757220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119047-3990-469b-ae9b-5b73008c8229 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:48.759933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 730/1473] 10.222.0.43 () {54 vars in 961 bytes} [Thu Mar 24 14:47:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:48.766480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9617f-7434-4325-af1d-a701600a5b6b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:48.766768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9617f-7434-4325-af1d-a701600a5b6b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:48.767038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9617f-7434-4325-af1d-a701600a5b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:48.786741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f2b9617f-7434-4325-af1d-a701600a5b6b None None] MFA Rules not processed for user `9c6a3dbc0cbe4acc81a8691fc85c7352`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:48.787922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f2b9617f-7434-4325-af1d-a701600a5b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:48.795571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 744/1474] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Mar 24 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:48.802929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09119047-3990-469b-ae9b-5b73008c8229 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:48.815381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09119047-3990-469b-ae9b-5b73008c8229 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:48.819387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb89893-496c-4b17-a1eb-cdacb6928139 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:48.820023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89893-496c-4b17-a1eb-cdacb6928139 service glance] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:48.820309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89893-496c-4b17-a1eb-cdacb6928139 service glance] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:48.820586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89893-496c-4b17-a1eb-cdacb6928139 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:48.829981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb89893-496c-4b17-a1eb-cdacb6928139 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:48.831438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb89893-496c-4b17-a1eb-cdacb6928139 service glance] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:48.841571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 731/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:51.236645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad6e2-bf0a-4e14-8855-dc574a4c78d8 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:51.237125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad6e2-bf0a-4e14-8855-dc574a4c78d8 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:51.237228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad6e2-bf0a-4e14-8855-dc574a4c78d8 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:51.239042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 745/1476] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:51.245348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779479-dc45-47f8-a9ea-fada557ab9ac None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:51.245800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779479-dc45-47f8-a9ea-fada557ab9ac None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:51.245912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61779479-dc45-47f8-a9ea-fada557ab9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:51.273947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-61779479-dc45-47f8-a9ea-fada557ab9ac None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:51.275157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-61779479-dc45-47f8-a9ea-fada557ab9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:51.283377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 732/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:51.307323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad6e2-bf0a-4e14-8855-dc574a4c78d8 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:51.326559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad6e2-bf0a-4e14-8855-dc574a4c78d8 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:51.332489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301f0d6-d8f6-4129-80d4-0eedfcb52132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:51.333133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f0d6-d8f6-4129-80d4-0eedfcb52132 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:51.333414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f0d6-d8f6-4129-80d4-0eedfcb52132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:51.333692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f0d6-d8f6-4129-80d4-0eedfcb52132 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:51.334463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301f0d6-d8f6-4129-80d4-0eedfcb52132 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:51.336209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-d301f0d6-d8f6-4129-80d4-0eedfcb52132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:47:51.336209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:47:51.336209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:47:51.337325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301f0d6-d8f6-4129-80d4-0eedfcb52132 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:51.356837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 746/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Mar 24 14:47:51 2022] GET /identity/v3/projects => generated 2553 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:47:53.676210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b37a-097c-401f-ac8f-ca9ac12449fd None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:53.676809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b37a-097c-401f-ac8f-ca9ac12449fd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:53.676809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b37a-097c-401f-ac8f-ca9ac12449fd None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:53.678561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 733/1479] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:53.684874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bb9c-59e5-45b1-909c-5f1e84b92cd7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:53.685636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bb9c-59e5-45b1-909c-5f1e84b92cd7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:53.685816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bb9c-59e5-45b1-909c-5f1e84b92cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:53.708680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d490bb9c-59e5-45b1-909c-5f1e84b92cd7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:53.709857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d490bb9c-59e5-45b1-909c-5f1e84b92cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:53.719068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 747/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:53.762001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45b37a-097c-401f-ac8f-ca9ac12449fd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:53.783817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45b37a-097c-401f-ac8f-ca9ac12449fd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:53.791198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228d63a-bc01-4f2b-9dbb-cab099f12adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:53.791828 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d63a-bc01-4f2b-9dbb-cab099f12adc service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:53.792105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d63a-bc01-4f2b-9dbb-cab099f12adc service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:53.792375 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d63a-bc01-4f2b-9dbb-cab099f12adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:53.800389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228d63a-bc01-4f2b-9dbb-cab099f12adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:53.801946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228d63a-bc01-4f2b-9dbb-cab099f12adc service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:53.811175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 734/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:56.259752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8edf-74de-4b31-89b7-54ecf1c22573 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:56.260595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8edf-74de-4b31-89b7-54ecf1c22573 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:56.260595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8edf-74de-4b31-89b7-54ecf1c22573 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:56.263635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 748/1482] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:47:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:56.269819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5eaa-3df6-41bd-a1c1-3de2d8e14261 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:56.270563 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5eaa-3df6-41bd-a1c1-3de2d8e14261 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:56.270718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5eaa-3df6-41bd-a1c1-3de2d8e14261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:56.290777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-07ec5eaa-3df6-41bd-a1c1-3de2d8e14261 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:56.291968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-07ec5eaa-3df6-41bd-a1c1-3de2d8e14261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:56.301378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 735/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:56.336774 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8edf-74de-4b31-89b7-54ecf1c22573 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:56.348717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8edf-74de-4b31-89b7-54ecf1c22573 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:56.352387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784d21b-020f-46b7-81ea-de33490b0912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:56.353017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d21b-020f-46b7-81ea-de33490b0912 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:56.353293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d21b-020f-46b7-81ea-de33490b0912 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:56.353561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784d21b-020f-46b7-81ea-de33490b0912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:56.363409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784d21b-020f-46b7-81ea-de33490b0912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:56.364828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784d21b-020f-46b7-81ea-de33490b0912 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:56.374334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 749/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:47:58.666534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f24b7-499e-4c53-b3fe-1c27a4b9c203 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:58.667409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f24b7-499e-4c53-b3fe-1c27a4b9c203 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:58.667409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f24b7-499e-4c53-b3fe-1c27a4b9c203 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:58.670396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 736/1485] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:47:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:47:58.676546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5894f-208d-4815-a611-9fec3663e475 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:58.676982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5894f-208d-4815-a611-9fec3663e475 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:58.677104 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5894f-208d-4815-a611-9fec3663e475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:58.696604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d2b5894f-208d-4815-a611-9fec3663e475 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:47:58.697797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d2b5894f-208d-4815-a611-9fec3663e475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:47:58.706378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 750/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:47:58.745499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f24b7-499e-4c53-b3fe-1c27a4b9c203 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:47:58.762898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f24b7-499e-4c53-b3fe-1c27a4b9c203 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:47:58.768972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576f7f-a783-4646-8dd4-c33132656498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:47:58.769842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576f7f-a783-4646-8dd4-c33132656498 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:47:58.770245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576f7f-a783-4646-8dd4-c33132656498 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:47:58.770628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576f7f-a783-4646-8dd4-c33132656498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:47:58.780655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576f7f-a783-4646-8dd4-c33132656498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:47:58.782065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576f7f-a783-4646-8dd4-c33132656498 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:47:58.791571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 737/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:48:01.302570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f52d70-d78d-4cf3-ba19-bc4b5a3fbe78 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:48:01.303131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f52d70-d78d-4cf3-ba19-bc4b5a3fbe78 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:48:01.303131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f52d70-d78d-4cf3-ba19-bc4b5a3fbe78 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:48:01.304946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 751/1488] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:48:01.311309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9332bf-a47e-40de-9221-ddc48dfa1d56 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:48:01.311966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9332bf-a47e-40de-9221-ddc48dfa1d56 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:48:01.312208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9332bf-a47e-40de-9221-ddc48dfa1d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:48:01.334264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-0a9332bf-a47e-40de-9221-ddc48dfa1d56 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:48:01.335456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0a9332bf-a47e-40de-9221-ddc48dfa1d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:48:01.344491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 738/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:48:01.384441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f52d70-d78d-4cf3-ba19-bc4b5a3fbe78 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:48:01.397926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f52d70-d78d-4cf3-ba19-bc4b5a3fbe78 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:48:01.403011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa943-2b07-42bc-ac6d-13dff2e746c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:48:01.403647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa943-2b07-42bc-ac6d-13dff2e746c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:48:01.403933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa943-2b07-42bc-ac6d-13dff2e746c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:48:01.404203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa943-2b07-42bc-ac6d-13dff2e746c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:48:01.414215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa943-2b07-42bc-ac6d-13dff2e746c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:48:01.415639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa943-2b07-42bc-ac6d-13dff2e746c0 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:48:01.425207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 752/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:48:03.879323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957f3e-86a4-4424-8aa6-273af479a5e3 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:48:03.879901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957f3e-86a4-4424-8aa6-273af479a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:48:03.879901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957f3e-86a4-4424-8aa6-273af479a5e3 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:48:03.882592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 739/1491] 10.222.0.43 () {54 vars in 926 bytes} [Thu Mar 24 14:48:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:48:03.888106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb80e-b61c-4a99-ab51-7eceea29ec2a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:48:03.888533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb80e-b61c-4a99-ab51-7eceea29ec2a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:48:03.888698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb80e-b61c-4a99-ab51-7eceea29ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:48:03.908101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-560eb80e-b61c-4a99-ab51-7eceea29ec2a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:48:03.909293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-560eb80e-b61c-4a99-ab51-7eceea29ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:48:03.917649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 753/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Mar 24 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:48:03.956080 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14957f3e-86a4-4424-8aa6-273af479a5e3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:48:03.967447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14957f3e-86a4-4424-8aa6-273af479a5e3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:48:03.971488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3e1c-ca80-4c83-967b-932cc4a8698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:48:03.972123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3e1c-ca80-4c83-967b-932cc4a8698b service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:48:03.972397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3e1c-ca80-4c83-967b-932cc4a8698b service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:48:03.972670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3e1c-ca80-4c83-967b-932cc4a8698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:48:03.983628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3e1c-ca80-4c83-967b-932cc4a8698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:48:03.985424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3e1c-ca80-4c83-967b-932cc4a8698b service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:48:03.995893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 740/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:49:31.806144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94c661-f446-4a24-84b9-e355f3688191 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:31.807112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94c661-f446-4a24-84b9-e355f3688191 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:31.807112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94c661-f446-4a24-84b9-e355f3688191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:31.830466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-dc94c661-f446-4a24-84b9-e355f3688191 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:49:31.831639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dc94c661-f446-4a24-84b9-e355f3688191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:49:31.840920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 754/1494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:49:31.851478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600428-d51b-4d86-b8cc-f80ce9791fec None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:31.852020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600428-d51b-4d86-b8cc-f80ce9791fec None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:31.852144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600428-d51b-4d86-b8cc-f80ce9791fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:31.871521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-af600428-d51b-4d86-b8cc-f80ce9791fec None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:49:31.872724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-af600428-d51b-4d86-b8cc-f80ce9791fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:49:31.882245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 741/1495] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:49:31.887124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94c661-f446-4a24-84b9-e355f3688191 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:31.897069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94c661-f446-4a24-84b9-e355f3688191 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:31.901843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:31.902529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:31.902785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:31.903068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:31.903790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:49:31.904099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:31.905119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:31.905119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:49:31.905119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:49:31.905987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:31.917762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 755/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:49:31.925918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600428-d51b-4d86-b8cc-f80ce9791fec None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:31.934976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600428-d51b-4d86-b8cc-f80ce9791fec None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:31.940383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:31.941012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:31.941289 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:31.941560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:31.942288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:31.944035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING py.warnings [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:31.944035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: warnings.warn(msg) Mar 24 14:49:31.944035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: Mar 24 14:49:31.945387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:31.988570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 742/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:49:31 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:49:31.993864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:32.008871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03cb4d-3fe2-4239-8327-8a6fdaf7b612 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:32.065449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:32.066462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.066751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.067093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.068103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:32.069664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:32.069664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:49:32.069664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:49:32.071030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:32.094534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 756/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:49:31 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:49:32.100514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:32.111407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56833620-3d89-4a2e-b59c-47ad4c90ba98 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:32.116889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:32.117557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.117838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.118111 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.118870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:32.119885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING py.warnings [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:32.119885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: warnings.warn(msg) Mar 24 14:49:32.119885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: Mar 24 14:49:32.120760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:32.133880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 743/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:49:32.138469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:32.151664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4d3a-5157-4d65-b4d6-5d626e112f3e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:32.157414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a157f-cc7a-4c71-bc8f-b1009ff5c0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:32.158116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a157f-cc7a-4c71-bc8f-b1009ff5c0ab admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.158400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a157f-cc7a-4c71-bc8f-b1009ff5c0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.158672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a157f-cc7a-4c71-bc8f-b1009ff5c0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.159419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a157f-cc7a-4c71-bc8f-b1009ff5c0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:32.160432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-8f1a157f-cc7a-4c71-bc8f-b1009ff5c0ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:32.160432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:49:32.160432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:49:32.161287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a157f-cc7a-4c71-bc8f-b1009ff5c0ab admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:32.174704 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 757/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:49:32.178924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:32.189975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04be8cd-5017-47a0-9dac-894b2979ac9d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:32.195621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:32.196498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.196786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.197056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] PATH_INFO: `/v3/projects/75cc4d72e1884ed3aba6e222b8e70f1a/users/411275a4dfa1410094007fafb3df8515/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.213386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cc4d72e1884ed3aba6e222b8e70f1a, user_id=411275a4dfa1410094007fafb3df8515, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:32.214430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING py.warnings [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:32.214430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: warnings.warn(msg) Mar 24 14:49:32.214430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: Mar 24 14:49:32.216317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:32.230910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 744/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:49:32 2022] PUT /identity/v3/projects/75cc4d72e1884ed3aba6e222b8e70f1a/users/411275a4dfa1410094007fafb3df8515/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:49:32.242181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852b382-2650-4cf0-9b3d-125d78e184bf None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.242480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852b382-2650-4cf0-9b3d-125d78e184bf None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.242741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852b382-2650-4cf0-9b3d-125d78e184bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.269750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d852b382-2650-4cf0-9b3d-125d78e184bf None None] MFA Rules not processed for user `411275a4dfa1410094007fafb3df8515`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:49:32.271004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d852b382-2650-4cf0-9b3d-125d78e184bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:49:32.333468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 758/1502] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:49:32.344965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:32.428275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8de50-84d6-407a-be6f-0f5533f69ad3 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:32.435586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:32.436218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.436500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.436759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.445157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:32.446796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:32.456365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 745/1503] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:49:32.527964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5bf1-16eb-4b90-93bc-714487f7a8c4 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.528243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5bf1-16eb-4b90-93bc-714487f7a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.528525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5bf1-16eb-4b90-93bc-714487f7a8c4 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.530260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 759/1504] 10.222.0.43 () {52 vars in 829 bytes} [Thu Mar 24 14:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:49:32.534038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:32.605896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf9248-be69-4b54-b22e-5f8469ed13cf service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:32.611398 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:32.612302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.612585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.612885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] PATH_INFO: `/v3/users/411275a4dfa1410094007fafb3df8515` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.614240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=411275a4dfa1410094007fafb3df8515)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:32.615278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING py.warnings [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:32.615278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: warnings.warn(msg) Mar 24 14:49:32.615278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: Mar 24 14:49:32.616481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:32.682129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411275a4dfa1410094007fafb3df8515'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:32.694631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411275a4dfa1410094007fafb3df8515'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:32.695536 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411275a4dfa1410094007fafb3df8515'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:32.696288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411275a4dfa1410094007fafb3df8515'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:32.717846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411275a4dfa1410094007fafb3df8515'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:32.735734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 746/1505] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:49:32 2022] DELETE /identity/v3/users/411275a4dfa1410094007fafb3df8515 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:49:32.740335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.740627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.740929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.759177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:49:32.760439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:49:32.822719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 760/1506] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:49:32.833418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:32.834912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:49:32.894594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad7395-4b2f-4012-bf77-ca835aabd28f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:32.898921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390c1cf-0e8f-4c6f-8798-f1c063723637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:32.899571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c1cf-0e8f-4c6f-8798-f1c063723637 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:32.899854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c1cf-0e8f-4c6f-8798-f1c063723637 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:32.900128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c1cf-0e8f-4c6f-8798-f1c063723637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:32.910226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390c1cf-0e8f-4c6f-8798-f1c063723637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:32.911697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390c1cf-0e8f-4c6f-8798-f1c063723637 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:32.922300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 747/1507] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:49:33.276308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:49:33.277769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:49:33.290983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc72b8-fc44-4f9e-a6ad-4f868d9ec979 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:49:33.295887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:49:33.296712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:49:33.296990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:49:33.297251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] PATH_INFO: `/v3/projects/75cc4d72e1884ed3aba6e222b8e70f1a` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:49:33.298557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cc4d72e1884ed3aba6e222b8e70f1a)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:49:33.299658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:49:33.299658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:49:33.299658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:49:33.300862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:49:33.360572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cc4d72e1884ed3aba6e222b8e70f1a', 'request_id': 'req-070693a2-0940-4af6-8faf-b36d27067705'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:33.372624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cc4d72e1884ed3aba6e222b8e70f1a', 'request_id': 'req-070693a2-0940-4af6-8faf-b36d27067705'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:33.378582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cc4d72e1884ed3aba6e222b8e70f1a', 'request_id': 'req-070693a2-0940-4af6-8faf-b36d27067705'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:33.396223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] The token cache is being invalidate because project 75cc4d72e1884ed3aba6e222b8e70f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:49:33.396504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:33.397212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-070693a2-0940-4af6-8faf-b36d27067705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:49:33.398896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 761/1508] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:49:33 2022] DELETE /identity/v3/projects/75cc4d72e1884ed3aba6e222b8e70f1a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:51:10.646568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3288f6-dabb-4ba5-b659-278a3de24b34 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:10.647202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3288f6-dabb-4ba5-b659-278a3de24b34 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:10.647202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3288f6-dabb-4ba5-b659-278a3de24b34 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:10.649913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 748/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:10.655918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175b14-d2d6-4f71-9816-6cad939496eb None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:10.656365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175b14-d2d6-4f71-9816-6cad939496eb None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:10.656472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175b14-d2d6-4f71-9816-6cad939496eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:10.677829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5d175b14-d2d6-4f71-9816-6cad939496eb None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:10.679046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5d175b14-d2d6-4f71-9816-6cad939496eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:10.736061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 762/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:10.889993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3288f6-dabb-4ba5-b659-278a3de24b34 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:10.893174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ad3288f6-dabb-4ba5-b659-278a3de24b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:10.978535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3288f6-dabb-4ba5-b659-278a3de24b34 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:10.984936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b156-4970-4004-9412-b5ccdccd543e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:10.985576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b156-4970-4004-9412-b5ccdccd543e service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:10.985850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b156-4970-4004-9412-b5ccdccd543e service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:10.986207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b156-4970-4004-9412-b5ccdccd543e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:10.994921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b156-4970-4004-9412-b5ccdccd543e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:10.996559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b156-4970-4004-9412-b5ccdccd543e service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:11.006554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 749/1511] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:11.182184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de11b0-dbd4-4a44-9f23-e71627298e34 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:11.182425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de11b0-dbd4-4a44-9f23-e71627298e34 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:11.182698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de11b0-dbd4-4a44-9f23-e71627298e34 None None] PATH_INFO: `/v3` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:11.184026 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 763/1512] 10.222.0.46 () {54 vars in 925 bytes} [Thu Mar 24 14:51:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:51:11.191462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89032d85-9989-4d8a-a9f9-cbf4c56dd356 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:11.191777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89032d85-9989-4d8a-a9f9-cbf4c56dd356 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:11.192047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89032d85-9989-4d8a-a9f9-cbf4c56dd356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:11.212061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-89032d85-9989-4d8a-a9f9-cbf4c56dd356 None None] MFA Rules not processed for user `ca33f2f8bb0a4631912f0ed51c6f8c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:11.213249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-89032d85-9989-4d8a-a9f9-cbf4c56dd356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:11.281302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 750/1513] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Mar 24 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:12.272042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d4351-47ee-46af-8c83-4f4020f1e8fb None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:12.272966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d4351-47ee-46af-8c83-4f4020f1e8fb None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:12.272966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d4351-47ee-46af-8c83-4f4020f1e8fb None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:12.275620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:51:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:12.281299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847c91-d294-4f91-a844-5a0ca3bcb3c6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:12.281745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847c91-d294-4f91-a844-5a0ca3bcb3c6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:12.281855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847c91-d294-4f91-a844-5a0ca3bcb3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:12.308824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-5f847c91-d294-4f91-a844-5a0ca3bcb3c6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:12.310040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5f847c91-d294-4f91-a844-5a0ca3bcb3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:12.319505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:12.476291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d4351-47ee-46af-8c83-4f4020f1e8fb None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:12.499299 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d4351-47ee-46af-8c83-4f4020f1e8fb None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:12.506037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a0a4-773c-473c-92e2-67267a6d93d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:12.506723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a0a4-773c-473c-92e2-67267a6d93d8 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:12.507008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a0a4-773c-473c-92e2-67267a6d93d8 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:12.507283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a0a4-773c-473c-92e2-67267a6d93d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:12.516645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518a0a4-773c-473c-92e2-67267a6d93d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:12.518288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518a0a4-773c-473c-92e2-67267a6d93d8 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:12.528494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 765/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:20.282695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fbc6-fada-4623-b507-82ca25e0f618 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:20.283598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fbc6-fada-4623-b507-82ca25e0f618 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:20.283598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fbc6-fada-4623-b507-82ca25e0f618 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:20.286407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 752/1517] 10.222.0.43 () {54 vars in 960 bytes} [Thu Mar 24 14:51:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:20.292651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46fca-a45f-4de7-9c3e-f51a5e1a9f5f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:20.293510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46fca-a45f-4de7-9c3e-f51a5e1a9f5f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:20.293510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c46fca-a45f-4de7-9c3e-f51a5e1a9f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:20.313747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-16c46fca-a45f-4de7-9c3e-f51a5e1a9f5f None None] MFA Rules not processed for user `ca33f2f8bb0a4631912f0ed51c6f8c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:20.315016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-16c46fca-a45f-4de7-9c3e-f51a5e1a9f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:20.325441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 766/1518] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Mar 24 14:51:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:20.337173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047fbc6-fada-4623-b507-82ca25e0f618 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:20.353440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047fbc6-fada-4623-b507-82ca25e0f618 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:20.359568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4588b-ab8d-4325-a955-eb7945ef0078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca33f2f8bb0a4631912f0ed51c6f8c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:20.360227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4588b-ab8d-4325-a955-eb7945ef0078 service placement] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:20.360525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4588b-ab8d-4325-a955-eb7945ef0078 service placement] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:20.360798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4588b-ab8d-4325-a955-eb7945ef0078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:20.369732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4588b-ab8d-4325-a955-eb7945ef0078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:20.371385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4588b-ab8d-4325-a955-eb7945ef0078 service placement] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:20.381276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 753/1519] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:24.186672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767caed0-dbea-46d4-a527-c1a912fa15e8 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:24.187254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767caed0-dbea-46d4-a527-c1a912fa15e8 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:24.187254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767caed0-dbea-46d4-a527-c1a912fa15e8 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:24.189738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 767/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:24.194734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaafb11-52a7-4f6d-95c2-acf292d964fb None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:24.195188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaafb11-52a7-4f6d-95c2-acf292d964fb None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:24.195295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaafb11-52a7-4f6d-95c2-acf292d964fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:24.216588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-acaafb11-52a7-4f6d-95c2-acf292d964fb None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:24.217800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-acaafb11-52a7-4f6d-95c2-acf292d964fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:24.227176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 754/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:24.380291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767caed0-dbea-46d4-a527-c1a912fa15e8 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:24.404205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767caed0-dbea-46d4-a527-c1a912fa15e8 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:24.410152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f75fd-61ed-4735-964c-1e33d6f2d97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:24.410844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f75fd-61ed-4735-964c-1e33d6f2d97d service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:24.411125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f75fd-61ed-4735-964c-1e33d6f2d97d service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:24.411396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f75fd-61ed-4735-964c-1e33d6f2d97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:24.420036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f75fd-61ed-4735-964c-1e33d6f2d97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:24.421622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f75fd-61ed-4735-964c-1e33d6f2d97d service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:24.431388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 768/1522] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:25.671560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f39f-4035-4a9d-b3a0-350e52a66b6a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:25.672129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f39f-4035-4a9d-b3a0-350e52a66b6a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:25.672129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f39f-4035-4a9d-b3a0-350e52a66b6a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:25.673795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 755/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 24 14:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:25.678961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878980b-2128-411e-8a1c-48d81762b82b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:25.679404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878980b-2128-411e-8a1c-48d81762b82b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:25.679497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878980b-2128-411e-8a1c-48d81762b82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:25.698298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9878980b-2128-411e-8a1c-48d81762b82b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:25.699467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9878980b-2128-411e-8a1c-48d81762b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:25.708012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 769/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 24 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:25.860504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478f39f-4035-4a9d-b3a0-350e52a66b6a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:25.877291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478f39f-4035-4a9d-b3a0-350e52a66b6a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:25.883395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017347c1-0896-4a00-888f-c1dfdaacb063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:25.884051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017347c1-0896-4a00-888f-c1dfdaacb063 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:25.884334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017347c1-0896-4a00-888f-c1dfdaacb063 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:25.884609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017347c1-0896-4a00-888f-c1dfdaacb063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:25.892980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017347c1-0896-4a00-888f-c1dfdaacb063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:25.894683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017347c1-0896-4a00-888f-c1dfdaacb063 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:25.904794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 756/1525] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:30.159089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6339af-3bd9-4770-833b-0ea85e7ae6d8 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:30.159647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6339af-3bd9-4770-833b-0ea85e7ae6d8 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:30.159647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6339af-3bd9-4770-833b-0ea85e7ae6d8 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:30.161341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 770/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:30.170241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc2af-f395-4a2e-b304-f297830cdd1f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:30.170656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc2af-f395-4a2e-b304-f297830cdd1f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:30.170791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc2af-f395-4a2e-b304-f297830cdd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:30.189387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-94abc2af-f395-4a2e-b304-f297830cdd1f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:30.190650 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-94abc2af-f395-4a2e-b304-f297830cdd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:30.199369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 757/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:30.236193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6339af-3bd9-4770-833b-0ea85e7ae6d8 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:30.238279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ed6339af-3bd9-4770-833b-0ea85e7ae6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:30.296937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6339af-3bd9-4770-833b-0ea85e7ae6d8 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:30.300869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285997-65b7-4524-b9ec-a7a6d38a218f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:30.301537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285997-65b7-4524-b9ec-a7a6d38a218f service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:30.301817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285997-65b7-4524-b9ec-a7a6d38a218f service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:30.302103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285997-65b7-4524-b9ec-a7a6d38a218f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:30.311617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285997-65b7-4524-b9ec-a7a6d38a218f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:30.313049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285997-65b7-4524-b9ec-a7a6d38a218f service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:30.322378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 771/1528] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:32.588432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb377a-5012-459b-a585-60fef7dbb346 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:32.589266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb377a-5012-459b-a585-60fef7dbb346 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:32.589266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb377a-5012-459b-a585-60fef7dbb346 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:32.591665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 758/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:51:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:32.597449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf8d0-898e-4687-84ac-b52f7c1dd07a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:32.597923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf8d0-898e-4687-84ac-b52f7c1dd07a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:32.598023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf8d0-898e-4687-84ac-b52f7c1dd07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:32.617906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7ccaf8d0-898e-4687-84ac-b52f7c1dd07a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:32.619119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7ccaf8d0-898e-4687-84ac-b52f7c1dd07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:32.627695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 772/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:32.665889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb377a-5012-459b-a585-60fef7dbb346 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:32.678635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb377a-5012-459b-a585-60fef7dbb346 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:32.682464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c246d-811b-47cd-8ced-d9d1a75f20e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:32.683093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c246d-811b-47cd-8ced-d9d1a75f20e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:32.683372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c246d-811b-47cd-8ced-d9d1a75f20e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:32.683646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c246d-811b-47cd-8ced-d9d1a75f20e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:32.692491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c246d-811b-47cd-8ced-d9d1a75f20e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:32.693913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c246d-811b-47cd-8ced-d9d1a75f20e5 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:32.703233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 759/1531] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:36.553334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99c28c-80e8-4cfe-99cc-ca292cd95c9a None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:36.554341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99c28c-80e8-4cfe-99cc-ca292cd95c9a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:36.554628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99c28c-80e8-4cfe-99cc-ca292cd95c9a None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:36.556542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 773/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:36.562025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c042b7-5353-4d2b-ae37-7e12263661f1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:36.562661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c042b7-5353-4d2b-ae37-7e12263661f1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:36.562810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c042b7-5353-4d2b-ae37-7e12263661f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:36.583510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c9c042b7-5353-4d2b-ae37-7e12263661f1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:36.584709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c9c042b7-5353-4d2b-ae37-7e12263661f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:36.593581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 760/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:36.848424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99c28c-80e8-4cfe-99cc-ca292cd95c9a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:36.850512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6b99c28c-80e8-4cfe-99cc-ca292cd95c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:36.913497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99c28c-80e8-4cfe-99cc-ca292cd95c9a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:36.917659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595c9d7-700d-4d31-a8a4-d2f8478989b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:36.918341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c9d7-700d-4d31-a8a4-d2f8478989b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:36.918627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c9d7-700d-4d31-a8a4-d2f8478989b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:36.918962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c9d7-700d-4d31-a8a4-d2f8478989b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:36.928229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595c9d7-700d-4d31-a8a4-d2f8478989b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:36.929653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595c9d7-700d-4d31-a8a4-d2f8478989b8 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:36.939295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 774/1534] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:51:39.231486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7998aff-b118-48b2-aaf2-b65ed56bec8a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:39.232339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7998aff-b118-48b2-aaf2-b65ed56bec8a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:39.232339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7998aff-b118-48b2-aaf2-b65ed56bec8a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:39.235371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 761/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 24 14:51:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:39.240827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8d24-0f32-456d-bc43-6620f5b08d3d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:39.241274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8d24-0f32-456d-bc43-6620f5b08d3d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:39.241378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8d24-0f32-456d-bc43-6620f5b08d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:39.261826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-745d8d24-0f32-456d-bc43-6620f5b08d3d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:39.263063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-745d8d24-0f32-456d-bc43-6620f5b08d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:39.272355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 775/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 24 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:39.522850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29fd2-b357-4f53-81cb-05bbde839e66 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:39.523573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29fd2-b357-4f53-81cb-05bbde839e66 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:39.524221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b29fd2-b357-4f53-81cb-05bbde839e66 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:39.527566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 762/1537] 10.222.0.43 () {54 vars in 962 bytes} [Thu Mar 24 14:51:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:51:39.532677 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82153da-c69e-4bf1-a116-86b7804878ad None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:39.532965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82153da-c69e-4bf1-a116-86b7804878ad None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:39.533241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82153da-c69e-4bf1-a116-86b7804878ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:39.552921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b82153da-c69e-4bf1-a116-86b7804878ad None None] MFA Rules not processed for user `6c290be79dec4fe8b10bc04e691c00b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:51:39.554102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b82153da-c69e-4bf1-a116-86b7804878ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:51:39.561127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 776/1538] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Mar 24 14:51:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:51:39.570503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b29fd2-b357-4f53-81cb-05bbde839e66 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:51:39.582947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b29fd2-b357-4f53-81cb-05bbde839e66 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:51:39.586956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e90875-a909-4758-b83f-7deae32b29a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:51:39.587593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e90875-a909-4758-b83f-7deae32b29a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:51:39.587879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e90875-a909-4758-b83f-7deae32b29a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:51:39.588160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e90875-a909-4758-b83f-7deae32b29a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:51:39.597039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e90875-a909-4758-b83f-7deae32b29a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:51:39.598498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e90875-a909-4758-b83f-7deae32b29a0 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:51:39.607645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 763/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:06.963228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f159603-2f72-45a6-8927-f343c58524f2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:06.964325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f159603-2f72-45a6-8927-f343c58524f2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:06.964819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f159603-2f72-45a6-8927-f343c58524f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:06.986076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-6f159603-2f72-45a6-8927-f343c58524f2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:06.987688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6f159603-2f72-45a6-8927-f343c58524f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:06.996518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 777/1540] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.007344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ff7b-5e7e-4ce0-81c6-803c8cb9950a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.008356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ff7b-5e7e-4ce0-81c6-803c8cb9950a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.008853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ff7b-5e7e-4ce0-81c6-803c8cb9950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.033455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-fe60ff7b-5e7e-4ce0-81c6-803c8cb9950a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.035219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fe60ff7b-5e7e-4ce0-81c6-803c8cb9950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.048497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 764/1541] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.053765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f159603-2f72-45a6-8927-f343c58524f2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.068456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f159603-2f72-45a6-8927-f343c58524f2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.074216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.075318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.075815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.076306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.077413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:07.077938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.080168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.099819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 778/1542] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:07.109596 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ff7b-5e7e-4ce0-81c6-803c8cb9950a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.121378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ff7b-5e7e-4ce0-81c6-803c8cb9950a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.126564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a7e8a-6f1a-4da9-ba6e-76a1b89df4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.127604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7e8a-6f1a-4da9-ba6e-76a1b89df4bd admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.128205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7e8a-6f1a-4da9-ba6e-76a1b89df4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.128698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7e8a-6f1a-4da9-ba6e-76a1b89df4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.129616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a7e8a-6f1a-4da9-ba6e-76a1b89df4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.131785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a7e8a-6f1a-4da9-ba6e-76a1b89df4bd admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.166939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 765/1543] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:07.171766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.186046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac423e6d-dedd-4284-8b90-17eb6de0c9c9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.263659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ec79-24fd-453a-8386-80386cd39f03 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.264039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ec79-24fd-453a-8386-80386cd39f03 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.264276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9ec79-24fd-453a-8386-80386cd39f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.274691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.275755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.276252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.276844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.277766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.280340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.303370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-95d9ec79-24fd-453a-8386-80386cd39f03 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.306033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-95d9ec79-24fd-453a-8386-80386cd39f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.320275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 779/1544] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:07.326384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 766/1545] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:07.331357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.342114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07945d81-ab16-47b3-84a4-9b2c223f338c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.344368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07945d81-ab16-47b3-84a4-9b2c223f338c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.344888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07945d81-ab16-47b3-84a4-9b2c223f338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.350809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09171f2d-bee5-4395-a864-76e7cab1e42e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.362556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f408-7dc6-4910-aad6-db5dab5e4868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.363243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f408-7dc6-4910-aad6-db5dab5e4868 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.363528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f408-7dc6-4910-aad6-db5dab5e4868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.363862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f408-7dc6-4910-aad6-db5dab5e4868 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.364696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f408-7dc6-4910-aad6-db5dab5e4868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.366460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f408-7dc6-4910-aad6-db5dab5e4868 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.377182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-07945d81-ab16-47b3-84a4-9b2c223f338c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.377397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 780/1546] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:07.378709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783056-74f4-489b-8236-8ffe822a9574 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.379001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783056-74f4-489b-8236-8ffe822a9574 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.379282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783056-74f4-489b-8236-8ffe822a9574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.379567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-07945d81-ab16-47b3-84a4-9b2c223f338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.391026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 767/1547] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.392612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359939-129c-4934-8199-61c75ee3a0ad None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.393128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359939-129c-4934-8199-61c75ee3a0ad None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.393912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359939-129c-4934-8199-61c75ee3a0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.401271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-55783056-74f4-489b-8236-8ffe822a9574 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.405657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-55783056-74f4-489b-8236-8ffe822a9574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.421445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 781/1548] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.422880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4b359939-129c-4934-8199-61c75ee3a0ad None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.424191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55783056-74f4-489b-8236-8ffe822a9574 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.431581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4b359939-129c-4934-8199-61c75ee3a0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.449959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 768/1549] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.452702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55783056-74f4-489b-8236-8ffe822a9574 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.456101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7a06f-4d6a-4496-9af8-bd598cc8da57 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.457138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7a06f-4d6a-4496-9af8-bd598cc8da57 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.458031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7a06f-4d6a-4496-9af8-bd598cc8da57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.465643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.468150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.468711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.469266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.470844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.474143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.486096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-81f7a06f-4d6a-4496-9af8-bd598cc8da57 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.487041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 782/1550] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:07.487347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-81f7a06f-4d6a-4496-9af8-bd598cc8da57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.488047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.498378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 769/1551] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.500215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea466-26db-4c4b-9af4-0bf93ae22976 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.500740 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea466-26db-4c4b-9af4-0bf93ae22976 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.501248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceea466-26db-4c4b-9af4-0bf93ae22976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.503511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bafee-673e-44cc-aa38-3eb3e82badbf admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.509363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2cfec-6726-4aab-810a-4b737f05e5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.511016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2cfec-6726-4aab-810a-4b737f05e5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.511298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2cfec-6726-4aab-810a-4b737f05e5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.511572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2cfec-6726-4aab-810a-4b737f05e5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.512316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2cfec-6726-4aab-810a-4b737f05e5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:07.512618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2cfec-6726-4aab-810a-4b737f05e5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.514614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2cfec-6726-4aab-810a-4b737f05e5a3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.523162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-1ceea466-26db-4c4b-9af4-0bf93ae22976 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.524760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1ceea466-26db-4c4b-9af4-0bf93ae22976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.530470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 783/1552] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:07.531987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956da3-87cc-4dbe-bf7d-f446bd8d823e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.532270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956da3-87cc-4dbe-bf7d-f446bd8d823e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.532541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956da3-87cc-4dbe-bf7d-f446bd8d823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.535367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 770/1553] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.537003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f534-ec39-46d6-836b-4d4deb9d7e21 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.537519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f534-ec39-46d6-836b-4d4deb9d7e21 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.538266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f534-ec39-46d6-836b-4d4deb9d7e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.553262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e0956da3-87cc-4dbe-bf7d-f446bd8d823e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.554689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e0956da3-87cc-4dbe-bf7d-f446bd8d823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.558947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-5d94f534-ec39-46d6-836b-4d4deb9d7e21 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.560459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5d94f534-ec39-46d6-836b-4d4deb9d7e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.569570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 771/1554] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.570645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f534-ec39-46d6-836b-4d4deb9d7e21 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.571162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 784/1555] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.572201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956da3-87cc-4dbe-bf7d-f446bd8d823e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.581824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f534-ec39-46d6-836b-4d4deb9d7e21 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.583243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956da3-87cc-4dbe-bf7d-f446bd8d823e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.587276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.588136 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.588813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.588940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.589143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.589368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.589918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.590125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:07.590414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.590817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] PATH_INFO: `/v3/projects/d60ef6516f464105bbb22a953fe3a9e8/users/212d3a1984a34761a3b06eff9f26d44f/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.592021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.604439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 785/1556] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:07.605388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.611790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60ef6516f464105bbb22a953fe3a9e8, user_id=212d3a1984a34761a3b06eff9f26d44f, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.614695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.620914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c11401-2352-47e3-a208-bde6a3ced168 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.626852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205417-f802-41ea-9a1a-2d9f8413f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.627503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205417-f802-41ea-9a1a-2d9f8413f9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.627779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205417-f802-41ea-9a1a-2d9f8413f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.628049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205417-f802-41ea-9a1a-2d9f8413f9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.628737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205417-f802-41ea-9a1a-2d9f8413f9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.629981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-26205417-f802-41ea-9a1a-2d9f8413f9c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:53:07.629981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:53:07.629981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:53:07.631159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205417-f802-41ea-9a1a-2d9f8413f9c8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.632207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 772/1557] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:07 2022] PUT /identity/v3/projects/d60ef6516f464105bbb22a953fe3a9e8/users/212d3a1984a34761a3b06eff9f26d44f/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:07.633251 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.656753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 786/1558] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:07.657865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3524d-171a-48cc-90ea-41c7fba2bb5a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.658168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3524d-171a-48cc-90ea-41c7fba2bb5a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.658449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3524d-171a-48cc-90ea-41c7fba2bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.675729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d5d3524d-171a-48cc-90ea-41c7fba2bb5a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.676851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d5d3524d-171a-48cc-90ea-41c7fba2bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.691874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d121-f185-4d13-9959-606108918655 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.731957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 787/1559] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.733231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41515-12b6-468e-b834-c7e2aea07e81 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.733521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41515-12b6-468e-b834-c7e2aea07e81 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.733836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41515-12b6-468e-b834-c7e2aea07e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.746721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.747386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.747669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.747943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.748732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:07.749044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.750099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING py.warnings [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:53:07.750099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: warnings.warn(msg) Mar 24 14:53:07.750099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: Mar 24 14:53:07.751019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.752067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1af41515-12b6-468e-b834-c7e2aea07e81 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.753423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1af41515-12b6-468e-b834-c7e2aea07e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.761215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 788/1560] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.762452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dab1e-5238-430a-b705-fb0033238d5c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.762785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 773/1561] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:07.763573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.766452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dab1e-5238-430a-b705-fb0033238d5c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.766751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dab1e-5238-430a-b705-fb0033238d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.773540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159125a-3974-4e49-b349-8e2ef1d01118 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.778321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f060788-92f7-49bb-84b9-bc82df4553b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.779007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060788-92f7-49bb-84b9-bc82df4553b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.779294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060788-92f7-49bb-84b9-bc82df4553b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.779573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060788-92f7-49bb-84b9-bc82df4553b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.780256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f060788-92f7-49bb-84b9-bc82df4553b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.782316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f060788-92f7-49bb-84b9-bc82df4553b7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.784457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5d7dab1e-5238-430a-b705-fb0033238d5c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.785632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5d7dab1e-5238-430a-b705-fb0033238d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.793647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 789/1562] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.794737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7265e-2858-42e1-8da3-6768ffb52d64 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.795025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7265e-2858-42e1-8da3-6768ffb52d64 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.795307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7265e-2858-42e1-8da3-6768ffb52d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.812898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 774/1563] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:07.813486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b7c7265e-2858-42e1-8da3-6768ffb52d64 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.814259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df8208-de41-4380-94ce-9694bd2ec362 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.814547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df8208-de41-4380-94ce-9694bd2ec362 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.814703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b7c7265e-2858-42e1-8da3-6768ffb52d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.814822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df8208-de41-4380-94ce-9694bd2ec362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.831467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-51df8208-de41-4380-94ce-9694bd2ec362 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.832678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-51df8208-de41-4380-94ce-9694bd2ec362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.877298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 790/1564] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.878158 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7265e-2858-42e1-8da3-6768ffb52d64 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.887313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7265e-2858-42e1-8da3-6768ffb52d64 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.892163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.892826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.895991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.896115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 775/1565] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.896202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.896202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.896363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037f88-7305-4b35-845d-e895fe366361 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.896363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037f88-7305-4b35-845d-e895fe366361 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.896363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b037f88-7305-4b35-845d-e895fe366361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.897119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.915791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-1b037f88-7305-4b35-845d-e895fe366361 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:07.917025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1b037f88-7305-4b35-845d-e895fe366361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:07.920790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 791/1566] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:07.921621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.928994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 776/1567] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:07.930977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b037f88-7305-4b35-845d-e895fe366361 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.931421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc5e3d-4fe2-4b70-8787-56df2ad95963 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.936482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.937131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.937414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.937730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.938490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:07.938798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.940386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.940769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b037f88-7305-4b35-845d-e895fe366361 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.945506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.946270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.946555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.946831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.947521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.949386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.953346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 792/1568] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:07.954171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.964344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1324d83-df77-4114-9898-198e4b1c0f85 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:07.969103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e15183-ae50-403c-b220-d76cefe311d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:07.969760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e15183-ae50-403c-b220-d76cefe311d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.970037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e15183-ae50-403c-b220-d76cefe311d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.970384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e15183-ae50-403c-b220-d76cefe311d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:07.971098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e15183-ae50-403c-b220-d76cefe311d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:07.971401 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e15183-ae50-403c-b220-d76cefe311d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:07.972995 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e15183-ae50-403c-b220-d76cefe311d9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:07.983865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 777/1569] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:07.984883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:07.992278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 793/1570] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:07.992278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa0d02-46dc-4110-b0a5-faa7ff507abb None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:07.992278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa0d02-46dc-4110-b0a5-faa7ff507abb None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:07.992278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa0d02-46dc-4110-b0a5-faa7ff507abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.005332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-6faa0d02-46dc-4110-b0a5-faa7ff507abb None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:08.006561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6faa0d02-46dc-4110-b0a5-faa7ff507abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:08.044621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8697c-c22c-486c-9345-9602a5823441 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.049411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.050076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.050374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.050644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.051328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.052358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING py.warnings [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:53:08.052358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: warnings.warn(msg) Mar 24 14:53:08.052358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: Mar 24 14:53:08.053576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.061883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 794/1571] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:08.062859 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa0d02-46dc-4110-b0a5-faa7ff507abb None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.084250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 778/1572] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:07 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.084250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.093636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755baea-b350-4b06-9ff1-44fe211c276b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.098213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.098864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.099147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.099423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.100147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.101743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.113079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 779/1573] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.113891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.120842 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa0d02-46dc-4110-b0a5-faa7ff507abb None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.124324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.124962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.125122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ba4c-a9a1-4471-be62-6d51a889e79a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.125290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.125564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.129501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.130157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.130441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.130717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.131432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:08.131735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.133348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.134440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.135859 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.144727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 780/1574] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:08.145395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.146068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 795/1575] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:08.147012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.157518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb28fe-8c0a-4b63-83ff-b62115e4bbce service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.159910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b740db-5227-400e-9f38-028d29fbec33 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.162884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.163548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.163829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.164102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.164786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.165336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.166205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.166651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.166777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.167189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.168031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.169896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.193902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 796/1576] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.193902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.201053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 781/1577] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.201816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.205920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ec43d-b912-4fc2-b946-a60babcac830 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.266003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.266840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.267123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.267309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f74bc-21e6-4dad-8fcc-9a9bce4e7252 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.267434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.268189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.270799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.271946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.272753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.273042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.273316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.274044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:08.274543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.276247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.296193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 782/1578] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:08.296193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.302243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 797/1579] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.302874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daf44b-facd-478b-af9f-16922559bc01 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.303805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.372975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe27eac-b30b-4f1b-8466-443ae40c0b12 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.376848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.377539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.377796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.378132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.378256 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.378870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.378989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.379310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.379660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.380396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.380629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.382177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.391377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 783/1580] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.392231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.401278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 798/1581] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.401278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.406402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54706399-200b-4750-80a5-88ebcd812ffe admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.408890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027bfd9-041c-4e97-a7ed-8637c5e7e9ca admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.411246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.412176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.412176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.412454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.413151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.414839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.415470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.415683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.416078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.416439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.417325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.419024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.433705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 799/1582] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.434560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.447982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 784/1583] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.448198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ba0b-507f-4667-988d-3a5ee3d25757 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.448287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.506887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.507693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.508045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.508393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.509161 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.511194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.515252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad853-d3a4-4078-b596-23dbf47dc206 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.520000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.520659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.520973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.521210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.521902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.523828 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.533398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 800/1584] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.534051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.544367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a049c44-68df-465e-8355-fad1da7e79e4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.556740 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 785/1585] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.556740 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.557827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.558682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.558973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.559253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.560065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.562403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.594567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 801/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/users => generated 289 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.595476 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.606455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5c6c6-6379-4932-90c5-38c498289c50 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.651071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240a276-be1f-45a6-885d-c94cb889d479 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.657298 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.658300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.659081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.659863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.660477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.662828 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.672293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.673480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.673736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.673983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 786/1587] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.674116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] PATH_INFO: `/v3/projects/33da6542b7e344f7b0fd406f809d4cd6/users/3179ad957f3d4f60bc3abcfbc6f16927/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.675051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.686308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627fd67-7d3c-42be-b636-218f3976faf0 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.690015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=33da6542b7e344f7b0fd406f809d4cd6, user_id=3179ad957f3d4f60bc3abcfbc6f16927, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.691014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.691152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:53:08.691152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:53:08.691152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:53:08.691685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.691968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.692245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.692980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.693152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.694589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.705730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 787/1588] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.706587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.718174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 802/1589] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:08 2022] PUT /identity/v3/projects/33da6542b7e344f7b0fd406f809d4cd6/users/3179ad957f3d4f60bc3abcfbc6f16927/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:08.718174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.718470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9f1c2-8f13-4f27-89aa-b471308096ae admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.778756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.779443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.779731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.780002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.780245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38b90b-8f97-48ed-9072-99f4bd9788bb admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.780760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.783128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.784864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.785529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.785812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.786106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.786855 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.788432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.799536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 803/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.800359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.808790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 788/1591] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.810368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cedd4-3f87-4f17-95d8-8ff02fc61443 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.810507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.815234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.815933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.816215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.816491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.817178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.819150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.825143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dba0f-dab5-4876-9e1f-bc46b2c312b8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.833384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.834149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.834462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.834743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.835486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.837609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.848787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 804/1592] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:08.848787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.854807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 789/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:08.857044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd003b-1fcb-4e65-b518-f8f2265f88bc admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.858542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.861914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14469ba2-4ed2-49c6-80e8-2b4b15833f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.862847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469ba2-4ed2-49c6-80e8-2b4b15833f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.863157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469ba2-4ed2-49c6-80e8-2b4b15833f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.863405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469ba2-4ed2-49c6-80e8-2b4b15833f82 admin admin] PATH_INFO: `/v3/projects/335b33f41cb34e258ebd47a0bd128982/users/6bac7b20bdb348c09f0dd59abb7ae08b/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.871947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02871e2-3fbe-4965-8449-5bad89406a5c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:08.876578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:08.877542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.877906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.878185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] PATH_INFO: `/v3/projects/48695dad755f431289080f28ffc6f0d8/users/4f558c4579064393afc9d5cb58eacdd2/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.878627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14469ba2-4ed2-49c6-80e8-2b4b15833f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335b33f41cb34e258ebd47a0bd128982, user_id=6bac7b20bdb348c09f0dd59abb7ae08b, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.881322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14469ba2-4ed2-49c6-80e8-2b4b15833f82 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.895511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48695dad755f431289080f28ffc6f0d8, user_id=4f558c4579064393afc9d5cb58eacdd2, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:08.897301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 805/1594] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:08 2022] PUT /identity/v3/projects/335b33f41cb34e258ebd47a0bd128982/users/6bac7b20bdb348c09f0dd59abb7ae08b/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:08.901989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e46c-32a5-425e-8fc5-160b61f8e816 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:08.902426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e46c-32a5-425e-8fc5-160b61f8e816 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:08.902687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:08.902809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e46c-32a5-425e-8fc5-160b61f8e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:08.920888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 790/1595] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:08 2022] PUT /identity/v3/projects/48695dad755f431289080f28ffc6f0d8/users/4f558c4579064393afc9d5cb58eacdd2/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:08.921615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:08.934461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7098e46c-32a5-425e-8fc5-160b61f8e816 None None] MFA Rules not processed for user `3179ad957f3d4f60bc3abcfbc6f16927`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:08.935321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7098e46c-32a5-425e-8fc5-160b61f8e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:08.996544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e41b-183b-4788-8149-ced231fd0a00 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.001641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.002825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.002825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.003039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.003621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.005222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.015760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 791/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:09.016623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.019006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 806/1597] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:09.019891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098e46c-32a5-425e-8fc5-160b61f8e816 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.031561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0be0f-96e4-4b82-8006-eba5da5fe7b2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.039801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.040583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.045468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.046044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.046716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.047342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098e46c-32a5-425e-8fc5-160b61f8e816 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.048765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.052084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87d8b8-3892-4df2-a138-4490daa1cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.052819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87d8b8-3892-4df2-a138-4490daa1cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.053169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87d8b8-3892-4df2-a138-4490daa1cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.053507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87d8b8-3892-4df2-a138-4490daa1cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.054368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87d8b8-3892-4df2-a138-4490daa1cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.056193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87d8b8-3892-4df2-a138-4490daa1cd2d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.062168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 792/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:09.062336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.072140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 807/1599] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:09.072140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e79de-ee60-4784-bf60-7e9ef7425756 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.072140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e79de-ee60-4784-bf60-7e9ef7425756 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.072140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e79de-ee60-4784-bf60-7e9ef7425756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.075452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bd863-34da-41c2-8f4c-42af835d2cfb admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.082517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf42e-6e68-4c5b-a6b8-b57da238f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.083191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf42e-6e68-4c5b-a6b8-b57da238f769 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.083474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf42e-6e68-4c5b-a6b8-b57da238f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.083816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf42e-6e68-4c5b-a6b8-b57da238f769 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.084704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf42e-6e68-4c5b-a6b8-b57da238f769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.086922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf42e-6e68-4c5b-a6b8-b57da238f769 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.091335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-da5e79de-ee60-4784-bf60-7e9ef7425756 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:09.092618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-da5e79de-ee60-4784-bf60-7e9ef7425756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:09.098878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 793/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:09.102169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 808/1601] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:09.102976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e79de-ee60-4784-bf60-7e9ef7425756 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.103410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df73f25-f4c8-4af4-9fd2-c04c2b78029f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.103707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df73f25-f4c8-4af4-9fd2-c04c2b78029f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.103987 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df73f25-f4c8-4af4-9fd2-c04c2b78029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.113977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e79de-ee60-4784-bf60-7e9ef7425756 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.118771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.119661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.119998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.120274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] PATH_INFO: `/v3/projects/954b4133a08248a793e0416448286a00/users/19d82c3febb6432ea1740fd552dcc480/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.124129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3df73f25-f4c8-4af4-9fd2-c04c2b78029f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:09.125429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3df73f25-f4c8-4af4-9fd2-c04c2b78029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:09.139540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 794/1602] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:09.139540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b383df-1ef2-48cd-b690-5504a808c76e None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.139540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b383df-1ef2-48cd-b690-5504a808c76e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.139540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b383df-1ef2-48cd-b690-5504a808c76e None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.141383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 795/1603] 10.222.0.43 () {54 vars in 960 bytes} [Thu Mar 24 14:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:09.142127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b383df-1ef2-48cd-b690-5504a808c76e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.147590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954b4133a08248a793e0416448286a00, user_id=19d82c3febb6432ea1740fd552dcc480, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.152352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.155350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b383df-1ef2-48cd-b690-5504a808c76e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.161795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.162902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.163239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.163513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.164309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.165997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.173964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 809/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:09 2022] PUT /identity/v3/projects/954b4133a08248a793e0416448286a00/users/19d82c3febb6432ea1740fd552dcc480/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:09.181000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 796/1605] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:09.181000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.181253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.189225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7640b-2fd5-4fcb-900f-8b451d8dea63 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.256619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee78d5c-4f3b-45de-b2d3-d0c9678eaad2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.258614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f451515-7f5e-495d-940b-758e1372dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.259862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f451515-7f5e-495d-940b-758e1372dd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.260315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f451515-7f5e-495d-940b-758e1372dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.260907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f451515-7f5e-495d-940b-758e1372dd3a admin admin] PATH_INFO: `/v3/projects/546c38a2579b41db9797bffa819ca65b/users/011fa6cf9d534cd2a7e3d80326eec76f/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.261987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.262684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.262961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.263232 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.264124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.266595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.279189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f451515-7f5e-495d-940b-758e1372dd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=546c38a2579b41db9797bffa819ca65b, user_id=011fa6cf9d534cd2a7e3d80326eec76f, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.282061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f451515-7f5e-495d-940b-758e1372dd3a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.283319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 810/1606] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:09.284613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.286712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:09.307241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 797/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:09 2022] PUT /identity/v3/projects/546c38a2579b41db9797bffa819ca65b/users/011fa6cf9d534cd2a7e3d80326eec76f/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:09.307241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b1532-b2dd-4d84-a3c2-8bb50bbed22d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.307241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b1532-b2dd-4d84-a3c2-8bb50bbed22d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.307241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b1532-b2dd-4d84-a3c2-8bb50bbed22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.328345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c38b1532-b2dd-4d84-a3c2-8bb50bbed22d None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:09.330552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c38b1532-b2dd-4d84-a3c2-8bb50bbed22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:09.359837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd32d9-943c-45b3-95d5-c102ed1fe3da admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.422569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732cce9-0b89-4c4f-998a-abcc8551029b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.423236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cce9-0b89-4c4f-998a-abcc8551029b service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.423519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cce9-0b89-4c4f-998a-abcc8551029b service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.423793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732cce9-0b89-4c4f-998a-abcc8551029b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.431857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 798/1608] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Mar 24 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:09.432771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b1532-b2dd-4d84-a3c2-8bb50bbed22d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.446180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b1532-b2dd-4d84-a3c2-8bb50bbed22d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.451260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.452376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.452571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.452939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.493180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732cce9-0b89-4c4f-998a-abcc8551029b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.495885 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732cce9-0b89-4c4f-998a-abcc8551029b service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.517280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 811/1609] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:09.518818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c1b02-e42e-476f-b869-4b2a61b51a9b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.519111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c1b02-e42e-476f-b869-4b2a61b51a9b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.519393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c1b02-e42e-476f-b869-4b2a61b51a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.557222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.558719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.562471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2e2c1b02-e42e-476f-b869-4b2a61b51a9b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:09.564485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2e2c1b02-e42e-476f-b869-4b2a61b51a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:09.579290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 799/1610] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:09.582954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 812/1611] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:09.584270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.584420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c1b02-e42e-476f-b869-4b2a61b51a9b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.590555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df838-f2c1-45bc-9c30-1ff2fd067941 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.593802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c1b02-e42e-476f-b869-4b2a61b51a9b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.596210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af192-7e74-4f7e-af63-6029ab97721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.597111 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af192-7e74-4f7e-af63-6029ab97721b admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.597654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af192-7e74-4f7e-af63-6029ab97721b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.598645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af192-7e74-4f7e-af63-6029ab97721b admin admin] PATH_INFO: `/v3/projects/dd8e43b53aac471eb4c6b06bf83691e7/users/cad9d66b1f014d4b819931c6b896e9c8/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.600865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.603133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.603489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.603832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] PATH_INFO: `/v3/projects/70bbe56d901947879ad7ff4942d180c8/users/ded54ed4c416449287d85b2d9010a553/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.615152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00af192-7e74-4f7e-af63-6029ab97721b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8e43b53aac471eb4c6b06bf83691e7, user_id=cad9d66b1f014d4b819931c6b896e9c8, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.618546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00af192-7e74-4f7e-af63-6029ab97721b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.625505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bbe56d901947879ad7ff4942d180c8, user_id=ded54ed4c416449287d85b2d9010a553, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.628459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.647764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 800/1612] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:09 2022] PUT /identity/v3/projects/dd8e43b53aac471eb4c6b06bf83691e7/users/cad9d66b1f014d4b819931c6b896e9c8/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:09.647764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd003e-11fc-49c7-afe2-f540a7a8e9fa None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.647764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd003e-11fc-49c7-afe2-f540a7a8e9fa None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.647764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd003e-11fc-49c7-afe2-f540a7a8e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.652252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 813/1613] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:09 2022] PUT /identity/v3/projects/70bbe56d901947879ad7ff4942d180c8/users/ded54ed4c416449287d85b2d9010a553/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:09.653180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.665825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-eafd003e-11fc-49c7-afe2-f540a7a8e9fa None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:09.667464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-eafd003e-11fc-49c7-afe2-f540a7a8e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:09.744189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 801/1614] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:09.746120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649a0c1-49cc-4dae-b385-36f4ed20ffcc None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.746486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649a0c1-49cc-4dae-b385-36f4ed20ffcc None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.746931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649a0c1-49cc-4dae-b385-36f4ed20ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.801372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7649a0c1-49cc-4dae-b385-36f4ed20ffcc None None] MFA Rules not processed for user `cad9d66b1f014d4b819931c6b896e9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:09.802060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9beb-be75-4e8e-bc10-cfbb350067d7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:09.804668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7649a0c1-49cc-4dae-b385-36f4ed20ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:09.816303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef3959-f01e-430e-b2cf-911080e7501d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:09.817490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3959-f01e-430e-b2cf-911080e7501d service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.818901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3959-f01e-430e-b2cf-911080e7501d service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.819742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3959-f01e-430e-b2cf-911080e7501d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:09.943662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 802/1615] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:09.944348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef3959-f01e-430e-b2cf-911080e7501d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:09.946479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef3959-f01e-430e-b2cf-911080e7501d service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:09.949358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649a0c1-49cc-4dae-b385-36f4ed20ffcc None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:09.990275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 814/1616] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:09.991833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54d760-83c4-485d-99c6-a33d99cf8139 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:09.992240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54d760-83c4-485d-99c6-a33d99cf8139 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:09.992526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54d760-83c4-485d-99c6-a33d99cf8139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.032699 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ac54d760-83c4-485d-99c6-a33d99cf8139 None None] MFA Rules not processed for user `ded54ed4c416449287d85b2d9010a553`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:10.033913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ac54d760-83c4-485d-99c6-a33d99cf8139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:10.095523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649a0c1-49cc-4dae-b385-36f4ed20ffcc None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.117399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7d0fa-73f1-4ec5-8c00-da580b347882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.118098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d0fa-73f1-4ec5-8c00-da580b347882 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.118381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d0fa-73f1-4ec5-8c00-da580b347882 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.118655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d0fa-73f1-4ec5-8c00-da580b347882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.132816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 815/1617] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:10.136317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54d760-83c4-485d-99c6-a33d99cf8139 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.142940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7d0fa-73f1-4ec5-8c00-da580b347882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.178481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7d0fa-73f1-4ec5-8c00-da580b347882 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.191594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54d760-83c4-485d-99c6-a33d99cf8139 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.191594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757b6b3-fcd8-419a-9ea8-68d8b6659618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.191594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757b6b3-fcd8-419a-9ea8-68d8b6659618 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.191594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757b6b3-fcd8-419a-9ea8-68d8b6659618 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.192420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757b6b3-fcd8-419a-9ea8-68d8b6659618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.192512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 803/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:10.192512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b476-8a2e-466e-a433-15d1fdf133ba None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.192512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b476-8a2e-466e-a433-15d1fdf133ba None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.192512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5b476-8a2e-466e-a433-15d1fdf133ba None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.192512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 804/1619] 10.222.0.43 () {54 vars in 960 bytes} [Thu Mar 24 14:53:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:10.192512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b476-8a2e-466e-a433-15d1fdf133ba None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.196556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757b6b3-fcd8-419a-9ea8-68d8b6659618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.198603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757b6b3-fcd8-419a-9ea8-68d8b6659618 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.219363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5b476-8a2e-466e-a433-15d1fdf133ba None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.223888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 816/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:10.225165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdd582-c611-4cf2-86ec-b1be3fffb0cc None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.225460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdd582-c611-4cf2-86ec-b1be3fffb0cc None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.226598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdd582-c611-4cf2-86ec-b1be3fffb0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.229830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.230530 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.230817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.231142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.232355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.237092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.284940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-46cdd582-c611-4cf2-86ec-b1be3fffb0cc None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:10.286853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-46cdd582-c611-4cf2-86ec-b1be3fffb0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:10.304109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 805/1621] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:10 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:10.315347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.317825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 817/1622] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Mar 24 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:10.319350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdd582-c611-4cf2-86ec-b1be3fffb0cc None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.344745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdd582-c611-4cf2-86ec-b1be3fffb0cc None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.448657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305d19-fe45-4a8e-988d-54d1203a1f66 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.452715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc7a6-0cf7-472a-b3b2-15c74a7630d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.454182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc7a6-0cf7-472a-b3b2-15c74a7630d2 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.455768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc7a6-0cf7-472a-b3b2-15c74a7630d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.456280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc7a6-0cf7-472a-b3b2-15c74a7630d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.462769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.463460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.463743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.464020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.465050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.469665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.520774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 806/1623] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:10 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:10.524783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.553881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032215f-66e5-4eb5-90a6-0a2c4d3b1359 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.558264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bc7a6-0cf7-472a-b3b2-15c74a7630d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.560753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bc7a6-0cf7-472a-b3b2-15c74a7630d2 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.569317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3cc6c-3cf2-477d-8ce4-00fff6f9c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.570566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3cc6c-3cf2-477d-8ce4-00fff6f9c4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.570960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3cc6c-3cf2-477d-8ce4-00fff6f9c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.571926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3cc6c-3cf2-477d-8ce4-00fff6f9c4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.572777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3cc6c-3cf2-477d-8ce4-00fff6f9c4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.574531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3cc6c-3cf2-477d-8ce4-00fff6f9c4d5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.608868 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 818/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:10.612312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499acf-2cc7-4abe-9e4c-b305b8e43953 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.612698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499acf-2cc7-4abe-9e4c-b305b8e43953 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.613044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499acf-2cc7-4abe-9e4c-b305b8e43953 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.618167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 819/1625] 10.222.0.43 () {54 vars in 912 bytes} [Thu Mar 24 14:53:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:10.621988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 807/1626] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:10.623227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499acf-2cc7-4abe-9e4c-b305b8e43953 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.631518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab1e3-f995-4be4-b580-b57290e49071 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.632075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab1e3-f995-4be4-b580-b57290e49071 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.632417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab1e3-f995-4be4-b580-b57290e49071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.652258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499acf-2cc7-4abe-9e4c-b305b8e43953 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.666323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.667426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.668801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.669150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] PATH_INFO: `/v3/projects/2a046b33ee3749cab350c01662147c9f/users/9e3b79bf651c48b59a9a013c7cd0f6a3/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.674544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-16fab1e3-f995-4be4-b580-b57290e49071 None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:10.677512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-16fab1e3-f995-4be4-b580-b57290e49071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:10.704286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 808/1627] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:10.705583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a046b33ee3749cab350c01662147c9f, user_id=9e3b79bf651c48b59a9a013c7cd0f6a3, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.708512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.723204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fab1e3-f995-4be4-b580-b57290e49071 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.748403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 820/1628] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:10 2022] PUT /identity/v3/projects/2a046b33ee3749cab350c01662147c9f/users/9e3b79bf651c48b59a9a013c7cd0f6a3/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:10.752954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:10.847228 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fab1e3-f995-4be4-b580-b57290e49071 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.916809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849a29b-c922-4a06-a07b-7664d9af73e9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:10.939789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.941731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.943555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.943896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.945216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:10.950432 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:10.971761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef371e7-cfbf-407d-b502-9edcdbff6a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:10.974164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef371e7-cfbf-407d-b502-9edcdbff6a5c service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:10.980733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef371e7-cfbf-407d-b502-9edcdbff6a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:10.981496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef371e7-cfbf-407d-b502-9edcdbff6a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:10.993937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 821/1629] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:10.995172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:11.033183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dfddd-c73f-4dcb-bcdf-bd505f7fd62f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:11.051838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d339c06-a1ea-4bc8-92f1-0f15fa0116d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:11.053111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d339c06-a1ea-4bc8-92f1-0f15fa0116d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:11.053381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d339c06-a1ea-4bc8-92f1-0f15fa0116d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:11.053700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d339c06-a1ea-4bc8-92f1-0f15fa0116d2 admin admin] PATH_INFO: `/v3/projects/2a046b33ee3749cab350c01662147c9f/users/9e3b79bf651c48b59a9a013c7cd0f6a3/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:11.056040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d339c06-a1ea-4bc8-92f1-0f15fa0116d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a046b33ee3749cab350c01662147c9f, user_id=9e3b79bf651c48b59a9a013c7cd0f6a3, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:11.059751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d339c06-a1ea-4bc8-92f1-0f15fa0116d2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:11.087364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 822/1630] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:10 2022] PUT /identity/v3/projects/2a046b33ee3749cab350c01662147c9f/users/9e3b79bf651c48b59a9a013c7cd0f6a3/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:11.097865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1452-a6c7-45ba-a9aa-daeebb3fcc36 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:11.098341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1452-a6c7-45ba-a9aa-daeebb3fcc36 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:11.098621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1452-a6c7-45ba-a9aa-daeebb3fcc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:11.151693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b3aa1452-a6c7-45ba-a9aa-daeebb3fcc36 None None] MFA Rules not processed for user `9e3b79bf651c48b59a9a013c7cd0f6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:11.156526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b3aa1452-a6c7-45ba-a9aa-daeebb3fcc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:11.183318 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef371e7-cfbf-407d-b502-9edcdbff6a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:11.185007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef371e7-cfbf-407d-b502-9edcdbff6a5c service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:11.198250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 809/1631] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:11.199762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b20b-87da-4e64-bc49-70897169bb11 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:11.200158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b20b-87da-4e64-bc49-70897169bb11 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:11.200763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b20b-87da-4e64-bc49-70897169bb11 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:11.202996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 810/1632] 10.222.0.43 () {54 vars in 912 bytes} [Thu Mar 24 14:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:11.217051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c31688-b3c7-4639-a2ae-121ebb0c68f2 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:11.223666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c31688-b3c7-4639-a2ae-121ebb0c68f2 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:11.224117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c31688-b3c7-4639-a2ae-121ebb0c68f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:11.283723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b6c31688-b3c7-4639-a2ae-121ebb0c68f2 None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:11.288336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b6c31688-b3c7-4639-a2ae-121ebb0c68f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:11.326624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 823/1633] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:11.341383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1452-a6c7-45ba-a9aa-daeebb3fcc36 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:11.467318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1452-a6c7-45ba-a9aa-daeebb3fcc36 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:11.480221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:11.480898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:11.483132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:11.483419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:11.493028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 811/1634] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:11.513326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:11.517287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:11.542645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 824/1635] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:53:11.612035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c31688-b3c7-4639-a2ae-121ebb0c68f2 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:11.637954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c31688-b3c7-4639-a2ae-121ebb0c68f2 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:11.647082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:11.649714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:11.650615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:11.651726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:11.675710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:11.679027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:11.709480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 812/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:11.978581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:11.987881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c97d2-b9b8-4dfc-adc1-06e6e6b9ba19 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:11.999794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c0153-1862-46d6-9b1d-fd10953fa881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:12.000511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0153-1862-46d6-9b1d-fd10953fa881 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:12.000793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0153-1862-46d6-9b1d-fd10953fa881 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:12.001070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c0153-1862-46d6-9b1d-fd10953fa881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:12.144980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0153-1862-46d6-9b1d-fd10953fa881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:12.146837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c0153-1862-46d6-9b1d-fd10953fa881 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:12.158197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 825/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:12.267695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:12.455526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2c971-91a8-4da4-9dbc-92ec6a3c1703 service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:12.466326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:12.467612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:12.467885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:12.468188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] PATH_INFO: `/v3/users/cad9d66b1f014d4b819931c6b896e9c8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:12.474617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad9d66b1f014d4b819931c6b896e9c8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:12.477204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:12.589014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad9d66b1f014d4b819931c6b896e9c8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:12.600468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad9d66b1f014d4b819931c6b896e9c8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:12.602528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad9d66b1f014d4b819931c6b896e9c8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:12.604029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad9d66b1f014d4b819931c6b896e9c8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:12.629081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad9d66b1f014d4b819931c6b896e9c8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:12.651953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 813/1638] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:12 2022] DELETE /identity/v3/users/cad9d66b1f014d4b819931c6b896e9c8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:12.656031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d119fa-f3b7-4eee-9354-dc1e1ea04dcf None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:12.656671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d119fa-f3b7-4eee-9354-dc1e1ea04dcf None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:12.657132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d119fa-f3b7-4eee-9354-dc1e1ea04dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:12.699368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-43d119fa-f3b7-4eee-9354-dc1e1ea04dcf None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:12.700816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-43d119fa-f3b7-4eee-9354-dc1e1ea04dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:12.787117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 826/1639] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:12.801562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:12.804179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:12.929783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b85d62-02bf-47ff-b454-f991f0b21ffe admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:12.934076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951a53b-1b94-4fc1-9166-196488ba3b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:12.935353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951a53b-1b94-4fc1-9166-196488ba3b62 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:12.935876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951a53b-1b94-4fc1-9166-196488ba3b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:12.936378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951a53b-1b94-4fc1-9166-196488ba3b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:12.953977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951a53b-1b94-4fc1-9166-196488ba3b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:12.957328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951a53b-1b94-4fc1-9166-196488ba3b62 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:12.974187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 814/1640] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:13.120946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:13.121777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:13.121777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:13.155269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] MFA Rules not processed for user `19d82c3febb6432ea1740fd552dcc480`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:13.156816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:13.269111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 827/1641] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:13.281545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:13.282065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:13.282436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:13.315235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] MFA Rules not processed for user `19d82c3febb6432ea1740fd552dcc480`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:13.316944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:13.330235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 815/1642] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:13.342896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:13.346003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:13.567511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e2505-7d2e-4549-9abb-40b90049659e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:13.582659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e9d6f-17d6-46f5-9a69-73181769e136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:13.584560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9d6f-17d6-46f5-9a69-73181769e136 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:13.586320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9d6f-17d6-46f5-9a69-73181769e136 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:13.587262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e9d6f-17d6-46f5-9a69-73181769e136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:13.612355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e9d6f-17d6-46f5-9a69-73181769e136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:13.622286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e9d6f-17d6-46f5-9a69-73181769e136 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:13.653731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 828/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:14.618854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:14.623632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:14.651498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a839a-3b17-44f3-b9a3-1ec6e997c67e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:14.679767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:14.681632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:14.682604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:14.684220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] PATH_INFO: `/v3/projects/dd8e43b53aac471eb4c6b06bf83691e7` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:14.687097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8e43b53aac471eb4c6b06bf83691e7)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:14.689140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: WARNING py.warnings [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:53:14.689140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: warnings.warn(msg) Mar 24 14:53:14.689140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: Mar 24 14:53:14.694614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:14.895814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8e43b53aac471eb4c6b06bf83691e7', 'request_id': 'req-b35ec979-ca92-4b9f-aa43-477345f50a24'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:14.924574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8e43b53aac471eb4c6b06bf83691e7', 'request_id': 'req-b35ec979-ca92-4b9f-aa43-477345f50a24'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:14.948030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8e43b53aac471eb4c6b06bf83691e7', 'request_id': 'req-b35ec979-ca92-4b9f-aa43-477345f50a24'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:15.027893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2124fc-ee19-4e81-9e4e-dc8324301e5a None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.028464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2124fc-ee19-4e81-9e4e-dc8324301e5a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.028464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2124fc-ee19-4e81-9e4e-dc8324301e5a None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.030767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 829/1644] 10.222.0.43 () {54 vars in 912 bytes} [Thu Mar 24 14:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:53:15.031969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] The token cache is being invalidate because project dd8e43b53aac471eb4c6b06bf83691e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:15.032328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:15.038638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6144e03-32a6-4386-be5e-e93773b6923f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.039003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6144e03-32a6-4386-be5e-e93773b6923f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.039178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6144e03-32a6-4386-be5e-e93773b6923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.041161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35ec979-ca92-4b9f-aa43-477345f50a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:15.049037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 816/1645] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:14 2022] DELETE /identity/v3/projects/dd8e43b53aac471eb4c6b06bf83691e7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:15.055759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.056086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.060262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.132117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:15.137344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:15.180647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e6144e03-32a6-4386-be5e-e93773b6923f None None] MFA Rules not processed for user `750a6a7b35204c47ac16a584e7e71713`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:15.182220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e6144e03-32a6-4386-be5e-e93773b6923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:15.309182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 830/1646] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:53:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:15.312053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 817/1647] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:15.320023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae2a7-5782-4b49-8477-3316a172be4a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.320357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae2a7-5782-4b49-8477-3316a172be4a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.320642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae2a7-5782-4b49-8477-3316a172be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.359386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-cffae2a7-5782-4b49-8477-3316a172be4a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:15.364037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cffae2a7-5782-4b49-8477-3316a172be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:15.376421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:15.377820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:15.397030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 831/1648] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:15.400678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae2a7-5782-4b49-8477-3316a172be4a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:15.402929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afed09-9dde-4826-aa0a-8886995f0100 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:15.414532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:15.415215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.415496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.415767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.421645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae2a7-5782-4b49-8477-3316a172be4a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:15.425879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:15.427374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:15.436960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 818/1649] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:15.439323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:15.440176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.440466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.440743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.441481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:15.441786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:15.443444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:15.459462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 832/1650] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:15.464317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:15.484545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef51f-f1c5-4a92-beb5-7b406d433f96 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:15.495796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:15.496475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.496753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.497023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.497736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:15.500018 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:15.561382 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 819/1651] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:15 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:15.565109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:15.584656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722b838-7aaa-432d-a424-20cabd56f603 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:15.681169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:15.682065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.682390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.682667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.683424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:15.685669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:15.722192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 833/1652] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:15 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:15.726504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:15.743304 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404d8f-ba67-4a4b-933f-43fd9065a0e8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:15.759542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:15.760076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.760480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.760623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.761833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:15.763546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:15.775567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 820/1653] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:15.783227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:15.802059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f5bb7-2cfa-4b1e-9ad0-bb712d9599da admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:15.809245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67777-60ec-4ba0-a1ec-414116a6dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:15.810815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67777-60ec-4ba0-a1ec-414116a6dbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.811102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67777-60ec-4ba0-a1ec-414116a6dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.811523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67777-60ec-4ba0-a1ec-414116a6dbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.812272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67777-60ec-4ba0-a1ec-414116a6dbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:15.814477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67777-60ec-4ba0-a1ec-414116a6dbe6 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:15.837177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 834/1654] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:53:15.840965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:15.862455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a608e-5086-420e-9bb5-25c495d51a13 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:15.873151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:15.874216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.874790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.875938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] PATH_INFO: `/v3/projects/32f07a4595c248399053cd9beda2c5a0/users/f65d8df094064bf08662391bfec92786/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:15.920720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f07a4595c248399053cd9beda2c5a0, user_id=f65d8df094064bf08662391bfec92786, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:15.924120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:15.958275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 821/1655] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:15 2022] PUT /identity/v3/projects/32f07a4595c248399053cd9beda2c5a0/users/f65d8df094064bf08662391bfec92786/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:15.959577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad71e1-e46b-4f0a-b609-314f9424254d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:15.959946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad71e1-e46b-4f0a-b609-314f9424254d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:15.960238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad71e1-e46b-4f0a-b609-314f9424254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.003020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-47ad71e1-e46b-4f0a-b609-314f9424254d None None] MFA Rules not processed for user `f65d8df094064bf08662391bfec92786`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:16.004490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-47ad71e1-e46b-4f0a-b609-314f9424254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:16.090693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:16.103071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 835/1656] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:16.180718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb9d6-b2e0-44c2-8ad5-d352185220b0 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:16.187802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:16.188756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:16.189134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:16.189479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.190342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:16.192252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:16.225967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad71e1-e46b-4f0a-b609-314f9424254d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:16.227559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 822/1657] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:16 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:16.238045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad71e1-e46b-4f0a-b609-314f9424254d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:16.327880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:16.328633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:16.328963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:16.329587 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.330555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:16.334499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:16.379610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:16.392830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 836/1658] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:16 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:16.394519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6af7e-654b-47c1-b797-6a9c61101949 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:16.401785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:16.402630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:16.402988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:16.403345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.404325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:16.406020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:16.425564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:16.436774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 823/1659] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:16.440413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603b451-9128-4efe-ad22-0d6ec415f906 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:16.445599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:16.446770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:16.447056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:16.447329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] PATH_INFO: `/v3/projects/376173f1ed4a4d80be0d079d47642729/users/d6207a6322e34bfdb1918bacffc919a6/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.466445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376173f1ed4a4d80be0d079d47642729, user_id=d6207a6322e34bfdb1918bacffc919a6, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:16.469245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:16.492746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:16.492845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 837/1660] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:16 2022] PUT /identity/v3/projects/376173f1ed4a4d80be0d079d47642729/users/d6207a6322e34bfdb1918bacffc919a6/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:16.505861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79500ade-2877-4201-87c6-6eabdd6c9aa7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:16.607997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27f81-50cd-457b-95e9-2cbfe24360f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:16.609025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27f81-50cd-457b-95e9-2cbfe24360f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:16.609350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27f81-50cd-457b-95e9-2cbfe24360f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:16.609667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27f81-50cd-457b-95e9-2cbfe24360f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.610859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd27f81-50cd-457b-95e9-2cbfe24360f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:16.613421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd27f81-50cd-457b-95e9-2cbfe24360f4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:16.639080 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 824/1661] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:16.642921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:16.664369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c9d39-40ea-4c8c-b94b-f76173964d26 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:16.675483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:16.677707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:16.677837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:16.678237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] PATH_INFO: `/v3/projects/376173f1ed4a4d80be0d079d47642729/users/d6207a6322e34bfdb1918bacffc919a6/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.681174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] RBAC: Authorizing `identity:create_grant(project_id=376173f1ed4a4d80be0d079d47642729, user_id=d6207a6322e34bfdb1918bacffc919a6, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:16.689013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:16.721741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 838/1662] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:16 2022] PUT /identity/v3/projects/376173f1ed4a4d80be0d079d47642729/users/d6207a6322e34bfdb1918bacffc919a6/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:16.722224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4d05-bc10-4755-b13a-3ebf7ea86df9 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:16.722682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4d05-bc10-4755-b13a-3ebf7ea86df9 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:16.723115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4d05-bc10-4755-b13a-3ebf7ea86df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:16.786482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b9fb4d05-bc10-4755-b13a-3ebf7ea86df9 None None] MFA Rules not processed for user `d6207a6322e34bfdb1918bacffc919a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:16.788629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b9fb4d05-bc10-4755-b13a-3ebf7ea86df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:16.930303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 825/1663] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:16.939139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:16.943337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:17.052577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d219b0-9512-495f-b04c-a9c4a0b19e6d None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:17.053262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d219b0-9512-495f-b04c-a9c4a0b19e6d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:17.054852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d219b0-9512-495f-b04c-a9c4a0b19e6d None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:17.057994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 826/1664] 10.222.0.43 () {54 vars in 960 bytes} [Thu Mar 24 14:53:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:53:17.067662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97655-9b0b-4157-9ef6-ff8638c12d7f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:17.068165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97655-9b0b-4157-9ef6-ff8638c12d7f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:17.068766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b97655-9b0b-4157-9ef6-ff8638c12d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:17.108523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de559a6d-e1a9-4321-a706-3ceb5182962d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:17.120527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:17.121921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:17.124039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:17.124866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:17.145064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:17.147125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:17.149133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-34b97655-9b0b-4157-9ef6-ff8638c12d7f None None] MFA Rules not processed for user `ca33f2f8bb0a4631912f0ed51c6f8c87`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:17.151993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-34b97655-9b0b-4157-9ef6-ff8638c12d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:17.167256 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 839/1665] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:17.342643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 827/1666] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Mar 24 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:17.357655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:17.374236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feba164-53bc-454e-96b4-41ae14381c89 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:17.391622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906ffe-7d98-4643-ae1e-332172392d0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca33f2f8bb0a4631912f0ed51c6f8c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:17.391862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906ffe-7d98-4643-ae1e-332172392d0d service placement] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:17.392538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906ffe-7d98-4643-ae1e-332172392d0d service placement] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:17.392538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906ffe-7d98-4643-ae1e-332172392d0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:17.399986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-66906ffe-7d98-4643-ae1e-332172392d0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:17.444660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66906ffe-7d98-4643-ae1e-332172392d0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:17.449649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66906ffe-7d98-4643-ae1e-332172392d0d service placement] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:17.480337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 840/1667] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:18.057120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97655-9b0b-4157-9ef6-ff8638c12d7f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:18.304655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b97655-9b0b-4157-9ef6-ff8638c12d7f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:18.315508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:18.316407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:18.321303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:18.321679 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] PATH_INFO: `/v3/users/f65d8df094064bf08662391bfec92786` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:18.323405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65d8df094064bf08662391bfec92786)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:18.324868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:18.490817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65d8df094064bf08662391bfec92786'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:18.528787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65d8df094064bf08662391bfec92786'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:18.533566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65d8df094064bf08662391bfec92786'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:18.539474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65d8df094064bf08662391bfec92786'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:18.571995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65d8df094064bf08662391bfec92786'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:18.610749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 828/1668] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:18 2022] DELETE /identity/v3/users/f65d8df094064bf08662391bfec92786 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:18.614963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a94b-731d-4e4e-9c24-b2415af29514 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:18.616020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a94b-731d-4e4e-9c24-b2415af29514 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:18.616441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a94b-731d-4e4e-9c24-b2415af29514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:18.653053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e444a94b-731d-4e4e-9c24-b2415af29514 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:18.656215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e444a94b-731d-4e4e-9c24-b2415af29514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:18.851819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 841/1669] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:18.961388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:18.963100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:19.064580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8a7a-3aa6-4269-9965-60c537d67a7a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:19.069064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:19.070009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:19.070395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:19.070739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:19.084029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:19.101327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:19.116840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 829/1670] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:19.782945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f195ec-938a-4949-be2b-4efb086a63bd None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:19.783422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f195ec-938a-4949-be2b-4efb086a63bd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:19.783490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f195ec-938a-4949-be2b-4efb086a63bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:19.843259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-04f195ec-938a-4949-be2b-4efb086a63bd None None] MFA Rules not processed for user `4f558c4579064393afc9d5cb58eacdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:19.844654 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-04f195ec-938a-4949-be2b-4efb086a63bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:19.918636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:19.920067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:19.940860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bfdeb-6c79-4984-acc1-5cd70de18928 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:19.946581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:19.947872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:19.948560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:19.949026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] PATH_INFO: `/v3/projects/32f07a4595c248399053cd9beda2c5a0` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:19.950947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f07a4595c248399053cd9beda2c5a0)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:19.964253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:19.978962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 842/1671] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:19.989575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:19.990002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:19.990541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:20.028969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] MFA Rules not processed for user `4f558c4579064393afc9d5cb58eacdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:20.030455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:20.063155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f07a4595c248399053cd9beda2c5a0', 'request_id': 'req-1d47179e-7b87-47f0-ac9a-37072a8aad3b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.086352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f07a4595c248399053cd9beda2c5a0', 'request_id': 'req-1d47179e-7b87-47f0-ac9a-37072a8aad3b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.093583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f07a4595c248399053cd9beda2c5a0', 'request_id': 'req-1d47179e-7b87-47f0-ac9a-37072a8aad3b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.102131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 843/1672] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:20.112968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:20.113946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] The token cache is being invalidate because project 32f07a4595c248399053cd9beda2c5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:20.114644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.115722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:20.118905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.122126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 830/1673] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:19 2022] DELETE /identity/v3/projects/32f07a4595c248399053cd9beda2c5a0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:20.127762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:20.131078 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:20.234653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47179e-7b87-47f0-ac9a-37072a8aad3b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:20.241073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8637-e751-443e-99e4-526a338f51d4 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:20.241522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:20.242805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:20.243280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:20.243743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] PATH_INFO: `/v3/users/d6207a6322e34bfdb1918bacffc919a6` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:20.245573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6207a6322e34bfdb1918bacffc919a6)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:20.247735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:20.248581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:20.248727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:20.249227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:20.249637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:20.251925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:20.274662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:20.276675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:20.294740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 844/1674] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:53:20.319968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6207a6322e34bfdb1918bacffc919a6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.331281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6207a6322e34bfdb1918bacffc919a6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.332249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6207a6322e34bfdb1918bacffc919a6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.333054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6207a6322e34bfdb1918bacffc919a6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.349986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9fb2ca40-74ec-4b69-8e0f-ba5d9b4bf8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6207a6322e34bfdb1918bacffc919a6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.375315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 831/1675] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:20 2022] DELETE /identity/v3/users/d6207a6322e34bfdb1918bacffc919a6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:20.697377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:20.716080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e4b0-97b9-40e2-b7f1-da6b9a6bb05b service nova] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:20.797071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:20.799736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:20.800659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:20.801826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] PATH_INFO: `/v3/projects/376173f1ed4a4d80be0d079d47642729` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:20.803380 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376173f1ed4a4d80be0d079d47642729)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:20.805532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:20.913138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376173f1ed4a4d80be0d079d47642729', 'request_id': 'req-af34ad1e-02f9-4acd-89bd-587b8b884a61'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.928452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376173f1ed4a4d80be0d079d47642729', 'request_id': 'req-af34ad1e-02f9-4acd-89bd-587b8b884a61'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.945907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376173f1ed4a4d80be0d079d47642729', 'request_id': 'req-af34ad1e-02f9-4acd-89bd-587b8b884a61'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.961929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] The token cache is being invalidate because project 376173f1ed4a4d80be0d079d47642729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:20.962274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.962920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-af34ad1e-02f9-4acd-89bd-587b8b884a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:20.966520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 845/1676] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:20 2022] DELETE /identity/v3/projects/376173f1ed4a4d80be0d079d47642729 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:20.969549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c51d-8a2e-4a8d-9aae-28d816e97c50 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:20.969923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c51d-8a2e-4a8d-9aae-28d816e97c50 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:20.970347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c51d-8a2e-4a8d-9aae-28d816e97c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:20.992464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6e97c51d-8a2e-4a8d-9aae-28d816e97c50 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:20.993890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6e97c51d-8a2e-4a8d-9aae-28d816e97c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:21.084475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 832/1677] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:21.093692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e8c96-09dd-4013-a0b1-6c17e555d7b9 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.094117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e8c96-09dd-4013-a0b1-6c17e555d7b9 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.098176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e8c96-09dd-4013-a0b1-6c17e555d7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.120508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-744e8c96-09dd-4013-a0b1-6c17e555d7b9 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:21.121827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-744e8c96-09dd-4013-a0b1-6c17e555d7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:21.134030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 846/1678] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:21.138947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97c51d-8a2e-4a8d-9aae-28d816e97c50 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:21.148837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97c51d-8a2e-4a8d-9aae-28d816e97c50 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:21.153817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:21.154799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.155085 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.155427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.156234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:21.156539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:21.158227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:21.170717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 833/1679] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:21.175369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e8c96-09dd-4013-a0b1-6c17e555d7b9 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:21.185013 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e8c96-09dd-4013-a0b1-6c17e555d7b9 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:21.190389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:21.191080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.191364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.191643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.192354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:21.194385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:21.227458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 847/1680] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:21 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:21.229141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:21.241894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825414d6-f436-4c99-9c83-ccae6ed69e9b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:21.308725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:21.309729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.310014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.310327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.311052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:21.313090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:21.347753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 834/1681] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:21 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:21.352198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:21.380296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e344978-c598-41b0-93f4-17d702cbaffb admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:21.388653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:21.389690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.390191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.390769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.393024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:21.395831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:21.446438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:21.447681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 848/1682] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:21.466246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3cac2-b28f-4413-8c01-2625169076e7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:21.489142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359925-ce8f-404f-b4c3-544b81668102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:21.490878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359925-ce8f-404f-b4c3-544b81668102 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.491459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359925-ce8f-404f-b4c3-544b81668102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.491872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359925-ce8f-404f-b4c3-544b81668102 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.492804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359925-ce8f-404f-b4c3-544b81668102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:21.494600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359925-ce8f-404f-b4c3-544b81668102 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:21.510555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 835/1683] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:21.514616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:21.532370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3642f0e-15f5-4aae-984e-b58c8fbaebd8 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:21.542751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:21.543677 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.543953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.544223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] PATH_INFO: `/v3/projects/e229f89c82d644768edd56ac23949d43/users/5fec4a08c8f449d2a5b1d8adaf6de63c/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.580308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e229f89c82d644768edd56ac23949d43, user_id=5fec4a08c8f449d2a5b1d8adaf6de63c, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:21.583009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:21.609503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 849/1684] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:21 2022] PUT /identity/v3/projects/e229f89c82d644768edd56ac23949d43/users/5fec4a08c8f449d2a5b1d8adaf6de63c/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:21.620103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1e97d-a757-4831-902d-a7fbe61db9ac None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.620465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1e97d-a757-4831-902d-a7fbe61db9ac None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.620812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1e97d-a757-4831-902d-a7fbe61db9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.678852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c1d1e97d-a757-4831-902d-a7fbe61db9ac None None] MFA Rules not processed for user `5fec4a08c8f449d2a5b1d8adaf6de63c`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:21.680981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c1d1e97d-a757-4831-902d-a7fbe61db9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:21.784051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 836/1685] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:21.788789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:21.912117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9ef9-29c5-4c54-be4d-1ea5aec2946b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:21.918519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:21.919354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:21.919788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:21.920793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:21.921806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:21.924215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:21.999166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1e97d-a757-4831-902d-a7fbe61db9ac None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:22.001261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 850/1686] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:21 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:22.015600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1e97d-a757-4831-902d-a7fbe61db9ac None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:22.173198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:22.174652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:22.175083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:22.175499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:22.176430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:22.178784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:22.230635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 837/1687] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:21 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:22.233212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:22.255681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bd5cb-1dac-4e24-8f9c-a77e13c6a2d1 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:22.299861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:22.300882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:22.300882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:22.305395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:22.308632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:22.311521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:22.350878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 851/1688] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:22.351624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:22.368609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bb4d9-25c8-4f6b-907a-1f87c0f8698c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:22.380686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:22.381774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:22.382238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:22.382641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] PATH_INFO: `/v3/projects/398af7005c0b4be6ad6648dccfacd7b8/users/111ea7abccd642aa87f0e9c0aae09e87/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:22.437747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398af7005c0b4be6ad6648dccfacd7b8, user_id=111ea7abccd642aa87f0e9c0aae09e87, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:22.440481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:22.469983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 838/1689] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:22 2022] PUT /identity/v3/projects/398af7005c0b4be6ad6648dccfacd7b8/users/111ea7abccd642aa87f0e9c0aae09e87/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:22.473829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:22.492926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582681-317a-49b1-8e5e-2d3c3c88a776 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:22.688660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:22.691912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:22.781586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b7f90-86df-433b-b134-87ef8ec98c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:22.782414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7f90-86df-433b-b134-87ef8ec98c5e admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:22.782700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7f90-86df-433b-b134-87ef8ec98c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:22.782969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7f90-86df-433b-b134-87ef8ec98c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:22.783999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b7f90-86df-433b-b134-87ef8ec98c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:22.785330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b7f90-86df-433b-b134-87ef8ec98c5e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:22.861602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 852/1690] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:22.878388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b854ca-7aff-48b3-b44e-5a63d509d667 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:22.880686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b854ca-7aff-48b3-b44e-5a63d509d667 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:22.881114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b854ca-7aff-48b3-b44e-5a63d509d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:22.985903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d5a81-9822-4d1e-b5a9-172b8c1604b3 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:23.001208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-86b854ca-7aff-48b3-b44e-5a63d509d667 None None] MFA Rules not processed for user `212d3a1984a34761a3b06eff9f26d44f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:23.007865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-86b854ca-7aff-48b3-b44e-5a63d509d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:23.008831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:23.016173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:23.016753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:23.017036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] PATH_INFO: `/v3/users/3179ad957f3d4f60bc3abcfbc6f16927` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:23.023101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3179ad957f3d4f60bc3abcfbc6f16927)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:23.051746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:23.200742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3179ad957f3d4f60bc3abcfbc6f16927'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:23.210993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3179ad957f3d4f60bc3abcfbc6f16927'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:23.211915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3179ad957f3d4f60bc3abcfbc6f16927'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:23.212885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3179ad957f3d4f60bc3abcfbc6f16927'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:23.254098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-85aa900a-1777-4c98-ae5b-4a71d153a39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3179ad957f3d4f60bc3abcfbc6f16927'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:23.261325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 853/1691] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:23.270987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b854ca-7aff-48b3-b44e-5a63d509d667 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:23.283084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 839/1692] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:22 2022] DELETE /identity/v3/users/3179ad957f3d4f60bc3abcfbc6f16927 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:23.284766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:23.285309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:23.285955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:23.307998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b854ca-7aff-48b3-b44e-5a63d509d667 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:23.327767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] MFA Rules not processed for user `4f558c4579064393afc9d5cb58eacdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:23.329431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:23.467527 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 840/1693] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:23.469182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:23.472105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:23.495526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e44c60-82a1-4f8e-9282-c95e54c3f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:23.497785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e44c60-82a1-4f8e-9282-c95e54c3f691 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:23.498335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e44c60-82a1-4f8e-9282-c95e54c3f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:23.498745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e44c60-82a1-4f8e-9282-c95e54c3f691 admin admin] PATH_INFO: `/v3/projects/398af7005c0b4be6ad6648dccfacd7b8/users/111ea7abccd642aa87f0e9c0aae09e87/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:23.501603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e44c60-82a1-4f8e-9282-c95e54c3f691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398af7005c0b4be6ad6648dccfacd7b8, user_id=111ea7abccd642aa87f0e9c0aae09e87, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:23.504688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e44c60-82a1-4f8e-9282-c95e54c3f691 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:23.539485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 854/1694] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:23 2022] PUT /identity/v3/projects/398af7005c0b4be6ad6648dccfacd7b8/users/111ea7abccd642aa87f0e9c0aae09e87/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:23.545656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc20a-03ef-4a2b-8f32-93446cb889b7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:23.547675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc20a-03ef-4a2b-8f32-93446cb889b7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:23.548612 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc20a-03ef-4a2b-8f32-93446cb889b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:23.615050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-23fbc20a-03ef-4a2b-8f32-93446cb889b7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:23.622220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-23fbc20a-03ef-4a2b-8f32-93446cb889b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:23.787079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e88e5d-d4b9-483c-811d-026f89d68721 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:23.893357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 855/1695] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:23.901208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881284-8276-40aa-a939-313cffceec95 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:23.901512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881284-8276-40aa-a939-313cffceec95 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:23.906566 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881284-8276-40aa-a939-313cffceec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:23.941443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaf17f-577d-44e3-a076-b04eb6f5abb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:23.942802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf17f-577d-44e3-a076-b04eb6f5abb7 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:23.943093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf17f-577d-44e3-a076-b04eb6f5abb7 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:23.944918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaf17f-577d-44e3-a076-b04eb6f5abb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:23.950814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5bbaf17f-577d-44e3-a076-b04eb6f5abb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:23.977768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7d881284-8276-40aa-a939-313cffceec95 None None] MFA Rules not processed for user `111ea7abccd642aa87f0e9c0aae09e87`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:23.982193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7d881284-8276-40aa-a939-313cffceec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:24.120203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaf17f-577d-44e3-a076-b04eb6f5abb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:24.125526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaf17f-577d-44e3-a076-b04eb6f5abb7 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:24.153917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 841/1696] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:24.163602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:24.163893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:24.164176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:24.192816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 856/1697] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:24.198609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d881284-8276-40aa-a939-313cffceec95 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:24.202655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7d881284-8276-40aa-a939-313cffceec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:24.215477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:24.229896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:24.384772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d881284-8276-40aa-a939-313cffceec95 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:24.394542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:24.395223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:24.395507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:24.395783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:24.410792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 842/1698] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:53:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:24.411736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:24.416269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:24.418994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:24.420446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:24.449455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 857/1699] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:24.604022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68542dca-f614-4641-a1db-0df6963e8c42 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:24.613585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:24.615532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:24.615839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:24.616686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:24.657893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:24.663448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:24.709491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 843/1700] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:24.860412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:24.861886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:25.066367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0058aa0-09e6-4a19-a6ca-43009db14b7b service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:25.085664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:25.087046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:25.087335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:25.087656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:25.108100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:25.112671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:25.138378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 858/1701] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:53:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:53:28.592350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:28.594380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:28.661924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98737d9-9ab8-4e52-b126-3a5e96f12ea0 service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:28.690693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:28.698447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:28.698844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:28.703615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] PATH_INFO: `/v3/projects/33da6542b7e344f7b0fd406f809d4cd6` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:28.712810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33da6542b7e344f7b0fd406f809d4cd6)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:28.721852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:28.845640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:28.847505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:28.917982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f5ee-1354-46b5-b86e-0543f7212e0a service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:29.003223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33da6542b7e344f7b0fd406f809d4cd6', 'request_id': 'req-1a40c394-a7ff-4d15-a241-57de67596457'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.027724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33da6542b7e344f7b0fd406f809d4cd6', 'request_id': 'req-1a40c394-a7ff-4d15-a241-57de67596457'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.049912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33da6542b7e344f7b0fd406f809d4cd6', 'request_id': 'req-1a40c394-a7ff-4d15-a241-57de67596457'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.079470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] The token cache is being invalidate because project 33da6542b7e344f7b0fd406f809d4cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:29.080324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.083179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a40c394-a7ff-4d15-a241-57de67596457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.091699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 844/1702] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:28 2022] DELETE /identity/v3/projects/33da6542b7e344f7b0fd406f809d4cd6 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:29.098796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349cff-2c9a-47f0-87f1-beff416a504a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:29.099282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349cff-2c9a-47f0-87f1-beff416a504a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:29.099584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349cff-2c9a-47f0-87f1-beff416a504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:29.147406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-48349cff-2c9a-47f0-87f1-beff416a504a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:29.149079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-48349cff-2c9a-47f0-87f1-beff416a504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:29.241813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:29.242985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:29.243461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:29.247173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] PATH_INFO: `/v3/users/5fec4a08c8f449d2a5b1d8adaf6de63c` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:29.250437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fec4a08c8f449d2a5b1d8adaf6de63c)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:29.253362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: WARNING py.warnings [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 24 14:53:29.253362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: warnings.warn(msg) Mar 24 14:53:29.253362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: Mar 24 14:53:29.284493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:29.453216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 845/1703] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:29.492304 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83c83-74e2-4af9-93b2-9e76a20fc91c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:29.496604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83c83-74e2-4af9-93b2-9e76a20fc91c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:29.497359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83c83-74e2-4af9-93b2-9e76a20fc91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:29.603949 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e6b83c83-74e2-4af9-93b2-9e76a20fc91c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:29.605247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e6b83c83-74e2-4af9-93b2-9e76a20fc91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:29.656405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 846/1704] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:29.660498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b83c83-74e2-4af9-93b2-9e76a20fc91c None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:29.703900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b83c83-74e2-4af9-93b2-9e76a20fc91c None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:29.719114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:29.720148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:29.720617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:29.721109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:29.723396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:29.723881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:29.727954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:29.745097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fec4a08c8f449d2a5b1d8adaf6de63c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.755707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 847/1705] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:29.760910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:29.779837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958adbf1-854d-4f09-a728-aaa1bb05531e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:29.788680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:29.799626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fec4a08c8f449d2a5b1d8adaf6de63c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.801595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:29.802288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:29.802871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:29.804588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:29.807066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:29.830836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fec4a08c8f449d2a5b1d8adaf6de63c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.840027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fec4a08c8f449d2a5b1d8adaf6de63c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.840705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ec3a5153-4eda-41f6-900c-ced13707a503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fec4a08c8f449d2a5b1d8adaf6de63c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:29.855954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 859/1706] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:28 2022] DELETE /identity/v3/users/5fec4a08c8f449d2a5b1d8adaf6de63c => generated 0 bytes in 1010 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:29.859831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:29.860319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:29.860773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:29.879120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 848/1707] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:29 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:29.883570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:29.893776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:29.916452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:29.918181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:30.093596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 860/1708] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:30.190180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13478bd-60fb-49e1-8ef3-0098be987461 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:30.195954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:30.197977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:30.201368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:30.202853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.203139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.205502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.208364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:30.214260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:30.283607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 849/1709] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:29 2022] POST /identity/v3/users => generated 281 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:30.286948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:30.325462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d23446-24fb-4242-877f-14997ca6569a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:30.344649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:30.345803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.346229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.346539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.347384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:30.349499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:30.351133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03648c-09bb-4069-84bd-7e60c52f392e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:30.363664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3f682-3a9a-4b4c-87da-2f1f03688cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:30.364806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f682-3a9a-4b4c-87da-2f1f03688cdf service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.366440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f682-3a9a-4b4c-87da-2f1f03688cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.368627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f682-3a9a-4b4c-87da-2f1f03688cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.385043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 850/1710] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:30.386791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:30.401049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e399d08-84b6-41c5-8761-9323c9ab6cca admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:30.416466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:30.417491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.417781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.418051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.418947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:30.419079 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3f682-3a9a-4b4c-87da-2f1f03688cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:30.423563 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:30.425353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3f682-3a9a-4b4c-87da-2f1f03688cdf service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:30.453815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 851/1711] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:30.461729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:30.466831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 861/1712] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:53:30.487080 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961996d1-f597-458f-b14b-03cc75f01441 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:30.502030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a047b33-e37e-45b1-bdc1-380c745e7d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:30.503037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047b33-e37e-45b1-bdc1-380c745e7d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.503319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047b33-e37e-45b1-bdc1-380c745e7d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.503596 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047b33-e37e-45b1-bdc1-380c745e7d02 admin admin] PATH_INFO: `/v3/projects/99992a467e1c4ee995c3dd9552d43fbc/users/e425e0d167dd40b5a07903efde0a37c6/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.554616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a047b33-e37e-45b1-bdc1-380c745e7d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99992a467e1c4ee995c3dd9552d43fbc, user_id=e425e0d167dd40b5a07903efde0a37c6, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:30.561321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a047b33-e37e-45b1-bdc1-380c745e7d02 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:30.578642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.578817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.579126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.622661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 852/1713] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:30 2022] PUT /identity/v3/projects/99992a467e1c4ee995c3dd9552d43fbc/users/e425e0d167dd40b5a07903efde0a37c6/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:30.647469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e85d6-9787-41ba-85fd-17af8d1940d7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.647952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e85d6-9787-41ba-85fd-17af8d1940d7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.660540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e85d6-9787-41ba-85fd-17af8d1940d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.723434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] MFA Rules not processed for user `6bac7b20bdb348c09f0dd59abb7ae08b`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:30.726072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:30.769160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-538e85d6-9787-41ba-85fd-17af8d1940d7 None None] MFA Rules not processed for user `750a6a7b35204c47ac16a584e7e71713`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:30.777614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-538e85d6-9787-41ba-85fd-17af8d1940d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:30.986859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 853/1714] 10.222.0.46 () {58 vars in 1015 bytes} [Thu Mar 24 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:30.988307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:30.988599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:30.988881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:30.997337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 862/1715] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:31.021385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:31.034000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:31.115882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] MFA Rules not processed for user `e425e0d167dd40b5a07903efde0a37c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:31.117414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:31.262291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 854/1716] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:31.263326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:31.265970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:31.295187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09aa74-4741-42ca-92a5-d43831968676 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:31.304410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:31.305332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:31.305706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:31.306115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:31.328559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:31.330565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:31.350535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 855/1717] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:31.351461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:31.430424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaf620-2386-42f3-a2e0-e92c41d1da7f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:31.457550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:31.458274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:31.465834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:31.467250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:31.501904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:31.503631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:31.539749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 863/1718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:31.596643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bb62-3008-441f-9bb6-4e85dfa7ca53 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:31.612529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:31.613151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:31.613713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:31.614240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:31.622773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:31.631528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:31.804000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 856/1719] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:31 2022] POST /identity/v3/projects => generated 363 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:31.808254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:31.838691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc139d2-ce75-41a1-8a82-8c965f96e4cd service nova] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:32.032101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:32.033436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:32.033719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:32.035257 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:32.047140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:32.054882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:32.179636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 864/1720] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:31 2022] POST /identity/v3/users => generated 288 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:32.182815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:32.201808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c536076-d676-4dab-b8d6-c858fbccb41b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:32.215349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:32.216421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:32.216910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:32.217388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:32.219345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:32.240611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:32.270259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 857/1721] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:32.271137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:32.290714 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69745-febb-43ea-8a7d-469bb2596799 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:32.309376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:32.310406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:32.310686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:32.310960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] PATH_INFO: `/v3/projects/8cd308acf2204cf3832f6ec783785ddf/users/6d9fec9f20164878ab4c7ccb1309becf/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:32.368459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd308acf2204cf3832f6ec783785ddf, user_id=6d9fec9f20164878ab4c7ccb1309becf, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:32.381713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:32.451340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 865/1722] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:32 2022] PUT /identity/v3/projects/8cd308acf2204cf3832f6ec783785ddf/users/6d9fec9f20164878ab4c7ccb1309becf/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:32.453590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:32.467904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ae7a8-caf8-45a8-8096-40400f0ccf74 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:32.716736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe7982-d587-4630-b956-fa78c8c3ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:32.718606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe7982-d587-4630-b956-fa78c8c3ee2d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:32.718902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe7982-d587-4630-b956-fa78c8c3ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:32.719205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe7982-d587-4630-b956-fa78c8c3ee2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:32.721917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe7982-d587-4630-b956-fa78c8c3ee2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:32.733617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe7982-d587-4630-b956-fa78c8c3ee2d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:32.765784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 858/1723] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:32.769270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:32.796014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaeb01-16e7-4a89-9b2a-e4e9a289e660 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:32.841942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:32.847849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:32.848556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:32.849162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] PATH_INFO: `/v3/projects/8cd308acf2204cf3832f6ec783785ddf/users/6d9fec9f20164878ab4c7ccb1309becf/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:32.858341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd308acf2204cf3832f6ec783785ddf, user_id=6d9fec9f20164878ab4c7ccb1309becf, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:32.861748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:32.907310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 866/1724] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:32 2022] PUT /identity/v3/projects/8cd308acf2204cf3832f6ec783785ddf/users/6d9fec9f20164878ab4c7ccb1309becf/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:32.918229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:32.918936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:32.919381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:33.065749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] MFA Rules not processed for user `6d9fec9f20164878ab4c7ccb1309becf`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:33.073983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:33.234125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 859/1725] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:32 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:33.245660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:33.248267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:33.445135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:33.447086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:33.511371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976cc75-b203-496f-84c8-073f9ff1037d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:33.524190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:33.524992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:33.528195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:33.531767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:33.590004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:33.595572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:33.654073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 867/1726] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:33.749220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ec7d3-72df-43ee-a94c-708dc4d31ea5 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:33.765461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:33.766389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:33.766670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:33.766985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] PATH_INFO: `/v3/projects/e229f89c82d644768edd56ac23949d43` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:33.770992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e229f89c82d644768edd56ac23949d43)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:33.784873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:33.924889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:33.935617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc540fc-b295-4d8d-80dc-5c6c8c519460 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:33.946728 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e229f89c82d644768edd56ac23949d43', 'request_id': 'req-daf38243-3396-46dd-8c57-ca8398f0f156'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:33.998551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e229f89c82d644768edd56ac23949d43', 'request_id': 'req-daf38243-3396-46dd-8c57-ca8398f0f156'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.032392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e229f89c82d644768edd56ac23949d43', 'request_id': 'req-daf38243-3396-46dd-8c57-ca8398f0f156'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.096858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] The token cache is being invalidate because project e229f89c82d644768edd56ac23949d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:34.104564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.107537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.131247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 860/1727] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:33 2022] DELETE /identity/v3/projects/e229f89c82d644768edd56ac23949d43 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:34.142461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:34.144784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:34.159764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885480-8569-4792-8c43-55d908b99c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:34.160309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885480-8569-4792-8c43-55d908b99c48 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:34.162810 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885480-8569-4792-8c43-55d908b99c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:34.163093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885480-8569-4792-8c43-55d908b99c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:34.169821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-24885480-8569-4792-8c43-55d908b99c48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:34.360038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885480-8569-4792-8c43-55d908b99c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:34.365460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885480-8569-4792-8c43-55d908b99c48 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:34.391550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 868/1728] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:53:34.516852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf38243-3396-46dd-8c57-ca8398f0f156 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:34.539591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:34.540687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:34.543527 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:34.546363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] PATH_INFO: `/v3/users/111ea7abccd642aa87f0e9c0aae09e87` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:34.551027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111ea7abccd642aa87f0e9c0aae09e87)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:34.565092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:34.676092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111ea7abccd642aa87f0e9c0aae09e87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.711157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111ea7abccd642aa87f0e9c0aae09e87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.720489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111ea7abccd642aa87f0e9c0aae09e87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.725357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111ea7abccd642aa87f0e9c0aae09e87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.755036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111ea7abccd642aa87f0e9c0aae09e87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:34.800841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 861/1729] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:34 2022] DELETE /identity/v3/users/111ea7abccd642aa87f0e9c0aae09e87 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:36.735099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c2322-2e3b-4bb5-a484-db1865d3a546 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:36.736358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c2322-2e3b-4bb5-a484-db1865d3a546 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:36.736881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c2322-2e3b-4bb5-a484-db1865d3a546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:36.805898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ed9c2322-2e3b-4bb5-a484-db1865d3a546 None None] MFA Rules not processed for user `011fa6cf9d534cd2a7e3d80326eec76f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:36.810234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ed9c2322-2e3b-4bb5-a484-db1865d3a546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:36.987261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 869/1730] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:36.994867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:36.996477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:37.207418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982f803-0f7d-450d-b002-e6799b08f9f4 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:37.222412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:37.223095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:37.223382 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:37.223664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:37.240323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:37.242814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:37.253311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 862/1731] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:37.473818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56d619-6e53-40d3-9896-a517593b77b0 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:37.474378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56d619-6e53-40d3-9896-a517593b77b0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:37.478656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56d619-6e53-40d3-9896-a517593b77b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:37.514905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-be56d619-6e53-40d3-9896-a517593b77b0 None None] MFA Rules not processed for user `212d3a1984a34761a3b06eff9f26d44f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:37.516553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-be56d619-6e53-40d3-9896-a517593b77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:37.643476 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 870/1732] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:38.244652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:38.247613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:38.448933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5313c-b3f9-4dae-9855-da4234f3309e service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:38.468529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:38.470560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:38.471055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:38.477232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] PATH_INFO: `/v3/users/e425e0d167dd40b5a07903efde0a37c6` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:38.479151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e425e0d167dd40b5a07903efde0a37c6)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:38.481732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:38.603291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e425e0d167dd40b5a07903efde0a37c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:38.623802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e425e0d167dd40b5a07903efde0a37c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:38.625584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e425e0d167dd40b5a07903efde0a37c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:38.637033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e425e0d167dd40b5a07903efde0a37c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:38.657949 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e425e0d167dd40b5a07903efde0a37c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:38.687300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 863/1733] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:38 2022] DELETE /identity/v3/users/e425e0d167dd40b5a07903efde0a37c6 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:38.691801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b69-80ef-4e18-b426-c810226eaa3b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:38.692744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b69-80ef-4e18-b426-c810226eaa3b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:38.693255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51b69-80ef-4e18-b426-c810226eaa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:38.736329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e1e51b69-80ef-4e18-b426-c810226eaa3b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:38.737964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e1e51b69-80ef-4e18-b426-c810226eaa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:38.927142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 871/1734] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:38.988417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:38.991392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:39.076085 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3dad-1323-41ba-ac7e-dab367e78a82 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:39.077813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3dad-1323-41ba-ac7e-dab367e78a82 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:39.078619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3dad-1323-41ba-ac7e-dab367e78a82 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:39.083294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 872/1735] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:53:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:39.204058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d382-ea6b-40a8-94cf-13207833c608 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:39.209792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:39.209792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:39.210033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:39.210440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:39.234448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:39.236120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:39.256252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 864/1736] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:39.302926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9737d6-0ce4-4238-9673-1662c466507c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:39.304954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9737d6-0ce4-4238-9673-1662c466507c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:39.305963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9737d6-0ce4-4238-9673-1662c466507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:39.349801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-6b9737d6-0ce4-4238-9673-1662c466507c None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:39.351297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6b9737d6-0ce4-4238-9673-1662c466507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:39.416055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:39.417286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:39.447486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f09735-f8fc-4f88-a446-638e2a2e3317 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:39.492273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:39.493195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:39.493487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:39.497592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] PATH_INFO: `/v3/projects/398af7005c0b4be6ad6648dccfacd7b8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:39.504761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398af7005c0b4be6ad6648dccfacd7b8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:39.506785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:39.684785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 873/1737] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:39.703265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398af7005c0b4be6ad6648dccfacd7b8', 'request_id': 'req-05a1f204-039f-4ba2-b36c-6e7089b42a20'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:39.729905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398af7005c0b4be6ad6648dccfacd7b8', 'request_id': 'req-05a1f204-039f-4ba2-b36c-6e7089b42a20'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:39.760771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398af7005c0b4be6ad6648dccfacd7b8', 'request_id': 'req-05a1f204-039f-4ba2-b36c-6e7089b42a20'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:39.792312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] The token cache is being invalidate because project 398af7005c0b4be6ad6648dccfacd7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:39.793318 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:39.795934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05a1f204-039f-4ba2-b36c-6e7089b42a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:39.802364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 865/1738] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:39 2022] DELETE /identity/v3/projects/398af7005c0b4be6ad6648dccfacd7b8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:39.807374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81655d-cb58-42f3-8ac3-640eef650a5b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:39.808524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81655d-cb58-42f3-8ac3-640eef650a5b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:39.808902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81655d-cb58-42f3-8ac3-640eef650a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:39.864969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-bf81655d-cb58-42f3-8ac3-640eef650a5b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:39.867485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bf81655d-cb58-42f3-8ac3-640eef650a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:39.979943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 874/1739] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:39.989288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0562-aede-4eab-859f-ca5dc93a79c8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:39.990355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0562-aede-4eab-859f-ca5dc93a79c8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:39.990488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0562-aede-4eab-859f-ca5dc93a79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.053868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-de0e0562-aede-4eab-859f-ca5dc93a79c8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:40.055388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-de0e0562-aede-4eab-859f-ca5dc93a79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:40.105135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 866/1740] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:40.106976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81655d-cb58-42f3-8ac3-640eef650a5b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.121420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81655d-cb58-42f3-8ac3-640eef650a5b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:40.158330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:40.161051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:40.163593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:40.164254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.174448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:40.175559 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:40.180828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:40.223756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 875/1741] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:40.228702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e0562-aede-4eab-859f-ca5dc93a79c8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.242980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e0562-aede-4eab-859f-ca5dc93a79c8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:40.264156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:40.267575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:40.268470 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:40.269309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.270073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:40.273296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:40.332230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 867/1742] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:40 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:40.335009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.356552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0b39a-8549-4809-9528-7a0934c7eb4f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:40.541831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:40.542577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:40.542862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:40.543137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.543847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:40.547064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:40.600767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 876/1743] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:40 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:40.605739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.624273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7446e-97b6-4810-b7ff-97296e046d4c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:40.643395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:40.644125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:40.644436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:40.644712 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.652019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:40.653756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:40.654824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.660306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:40.691128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a017e02-81d5-462a-a87b-fd7d015c0182 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:40.697363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:40.698376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:40.699463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:40.699463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] PATH_INFO: `/v3/projects/99992a467e1c4ee995c3dd9552d43fbc` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.700294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99992a467e1c4ee995c3dd9552d43fbc)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:40.704353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 868/1744] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:40.704477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:40.706453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.724586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee0cc6-778a-4a5f-90c3-29acfe782be0 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:40.739334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:40.740840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:40.741692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:40.742661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.747420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:40.754245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:40.770928 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 869/1745] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:40.775547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.800919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9a368-bb3e-4d79-bb45-51e7ffd96da7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:40.814867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99992a467e1c4ee995c3dd9552d43fbc', 'request_id': 'req-fe69444a-e073-4794-8ac3-bf44982008b3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:40.828036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99992a467e1c4ee995c3dd9552d43fbc', 'request_id': 'req-fe69444a-e073-4794-8ac3-bf44982008b3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:40.836764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99992a467e1c4ee995c3dd9552d43fbc', 'request_id': 'req-fe69444a-e073-4794-8ac3-bf44982008b3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:40.850226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] The token cache is being invalidate because project 99992a467e1c4ee995c3dd9552d43fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:40.851316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:40.852529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:40.855662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 877/1746] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:40 2022] DELETE /identity/v3/projects/99992a467e1c4ee995c3dd9552d43fbc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:40.860536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.863151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:40.879373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:40.880509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:40.881224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:40.881651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] PATH_INFO: `/v3/projects/a1b059c1fcbc4ba7ac008f903e005f5e/users/8dc1f990948746bb976eac2d8642300a/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:40.906567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b059c1fcbc4ba7ac008f903e005f5e, user_id=8dc1f990948746bb976eac2d8642300a, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:40.909126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:40.940812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 870/1747] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:40 2022] PUT /identity/v3/projects/a1b059c1fcbc4ba7ac008f903e005f5e/users/8dc1f990948746bb976eac2d8642300a/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:40.941876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:40.951487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:41.118195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69444a-e073-4794-8ac3-bf44982008b3 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:41.141843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9722498-da83-4b3a-a77d-ec41cd14d2d6 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:41.160020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:41.160926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:41.161208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:41.161483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] PATH_INFO: `/v3/users/6d9fec9f20164878ab4c7ccb1309becf` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:41.168882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9fec9f20164878ab4c7ccb1309becf)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:41.171379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:41.249250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9fec9f20164878ab4c7ccb1309becf'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:41.261504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9fec9f20164878ab4c7ccb1309becf'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:41.262628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9fec9f20164878ab4c7ccb1309becf'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:41.263439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9fec9f20164878ab4c7ccb1309becf'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:41.280206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0371aba7-3747-44b7-bbd2-785d6e1806f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9fec9f20164878ab4c7ccb1309becf'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:41.293243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:41.293923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:41.294376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:41.294609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:41.298517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:41.312734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:41.314445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:41.318252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 871/1748] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:40 2022] DELETE /identity/v3/users/6d9fec9f20164878ab4c7ccb1309becf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:41.322580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823acbc1-ea86-4c89-b42c-7f8352a74b70 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:41.322870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823acbc1-ea86-4c89-b42c-7f8352a74b70 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:41.323149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823acbc1-ea86-4c89-b42c-7f8352a74b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:41.327630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 878/1749] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:41.448349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-823acbc1-ea86-4c89-b42c-7f8352a74b70 None None] MFA Rules not processed for user `8dc1f990948746bb976eac2d8642300a`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:41.461428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-823acbc1-ea86-4c89-b42c-7f8352a74b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:41.654283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 872/1750] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:41.659453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:41.661665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:41.680511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d898e-6ea9-4f87-a987-5e5d9d83a2a0 service nova] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:41.873054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:41.873920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:41.874589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:41.874976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:41.875795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:41.877842 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:41.941759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 879/1751] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:41 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:41.945714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823acbc1-ea86-4c89-b42c-7f8352a74b70 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:41.987204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823acbc1-ea86-4c89-b42c-7f8352a74b70 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:42.136077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:42.136777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.137063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.137345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.138062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:42.146284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:42.194174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 873/1752] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:41 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:42.199265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:42.238350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de1d78-9fbc-49ca-b103-a361e60e3286 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:42.255773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:42.257472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.257978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.258521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.259463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:42.261393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:42.276786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 880/1753] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:53:42.281764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:42.293786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074cfd1-2d57-4da8-adfd-cfe7f50af709 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:42.300166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:42.301392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.301906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.302582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] PATH_INFO: `/v3/projects/03fa754827124ff5a1efaad8a31801be/users/c0187c9e3a5347b19f61d5e7d7f08074/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.328007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fa754827124ff5a1efaad8a31801be, user_id=c0187c9e3a5347b19f61d5e7d7f08074, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:42.331750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:42.355515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 874/1754] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:42 2022] PUT /identity/v3/projects/03fa754827124ff5a1efaad8a31801be/users/c0187c9e3a5347b19f61d5e7d7f08074/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:42.359378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:42.371411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f16f3-d781-48c7-ad54-f8354aeff7b3 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:42.392520 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:42.395576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:42.558409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:42.560022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.560469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.561113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.562170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:42.562282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ab01a-5116-45bd-b4b3-d9b6f3fc1b0e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:42.567697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:42.575447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:42.576452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.584845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.585500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] PATH_INFO: `/v3/projects/8cd308acf2204cf3832f6ec783785ddf` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.586783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 881/1755] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:53:42.588071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd308acf2204cf3832f6ec783785ddf)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:42.590973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:42.592977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:42.621061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63498252-c630-4e7c-90a8-9cbe39e05424 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:42.641619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc988a1e-df31-4193-9511-a7ec03e971f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:42.642777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc988a1e-df31-4193-9511-a7ec03e971f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.644054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc988a1e-df31-4193-9511-a7ec03e971f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.644438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc988a1e-df31-4193-9511-a7ec03e971f8 admin admin] PATH_INFO: `/v3/projects/03fa754827124ff5a1efaad8a31801be/users/c0187c9e3a5347b19f61d5e7d7f08074/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.649337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc988a1e-df31-4193-9511-a7ec03e971f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fa754827124ff5a1efaad8a31801be, user_id=c0187c9e3a5347b19f61d5e7d7f08074, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:42.654503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc988a1e-df31-4193-9511-a7ec03e971f8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:42.682319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 882/1756] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:42 2022] PUT /identity/v3/projects/03fa754827124ff5a1efaad8a31801be/users/c0187c9e3a5347b19f61d5e7d7f08074/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:42.700162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.701874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.703113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.707750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd308acf2204cf3832f6ec783785ddf', 'request_id': 'req-828209c0-c246-453d-ac55-ca044fc5cd23'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:42.737928 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd308acf2204cf3832f6ec783785ddf', 'request_id': 'req-828209c0-c246-453d-ac55-ca044fc5cd23'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:42.765915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd308acf2204cf3832f6ec783785ddf', 'request_id': 'req-828209c0-c246-453d-ac55-ca044fc5cd23'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:42.799459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] The token cache is being invalidate because project 8cd308acf2204cf3832f6ec783785ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:42.802639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:42.804759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] MFA Rules not processed for user `c0187c9e3a5347b19f61d5e7d7f08074`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:42.805316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-828209c0-c246-453d-ac55-ca044fc5cd23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:42.811073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 875/1757] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:42 2022] DELETE /identity/v3/projects/8cd308acf2204cf3832f6ec783785ddf => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:42.811294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:42.819427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169e514-1a37-4e2e-9d1a-d5d934e27f9c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:42.820128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169e514-1a37-4e2e-9d1a-d5d934e27f9c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:42.820623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169e514-1a37-4e2e-9d1a-d5d934e27f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:42.887372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4169e514-1a37-4e2e-9d1a-d5d934e27f9c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:42.892693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4169e514-1a37-4e2e-9d1a-d5d934e27f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:43.019777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 883/1758] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:43.032257 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.034019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:43.084096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 876/1759] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:43.093093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e61e-8926-490c-8c9c-0fec5d1d78fd None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.093469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e61e-8926-490c-8c9c-0fec5d1d78fd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.093811 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9e61e-8926-490c-8c9c-0fec5d1d78fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.124727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c2b9e61e-8926-490c-8c9c-0fec5d1d78fd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:43.132281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c2b9e61e-8926-490c-8c9c-0fec5d1d78fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:43.148184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 877/1760] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:43.152195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9e61e-8926-490c-8c9c-0fec5d1d78fd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.173933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ef0be-883e-4829-8b07-5f426b0857f5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:43.184691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:43.185397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.185702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.185996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.186986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9e61e-8926-490c-8c9c-0fec5d1d78fd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:43.200152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:43.201101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.201486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.201858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.202836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:43.203244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:43.206621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:43.206821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:43.208496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:43.223308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 884/1761] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:53:43.253937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 878/1762] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:53:43.259988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.288073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df8095-f268-4d13-8a40-7d3ec5f7c512 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:43.296251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:43.299304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.299806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.300277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.301711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:43.307240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:43.413844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 885/1763] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:43 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:43.417873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.433156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca5a20-f096-4785-a125-81ad378bbd2c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:43.608405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:43.609762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.610713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.611188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.612162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:43.620685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:43.699952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.701837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 879/1764] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:43 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:43.715138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7dc4c-95f9-4edc-8d64-288583ef041d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:43.720835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455817f-f20c-4f27-97c1-df8bbf374b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:43.722169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455817f-f20c-4f27-97c1-df8bbf374b8c admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.722600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455817f-f20c-4f27-97c1-df8bbf374b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.723050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455817f-f20c-4f27-97c1-df8bbf374b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.724070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455817f-f20c-4f27-97c1-df8bbf374b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:43.725987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455817f-f20c-4f27-97c1-df8bbf374b8c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:43.756423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 886/1765] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:53:43.757451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.770457 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9c8b6-544c-469c-94c1-90ab372f3493 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:43.787738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:43.790394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.790773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.791131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.792444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:43.796238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:43.816473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 880/1766] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:53:43.823870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e662-4ec6-4c3d-a5f4-23f3521e72d4 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.824230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e662-4ec6-4c3d-a5f4-23f3521e72d4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.824696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e662-4ec6-4c3d-a5f4-23f3521e72d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.838378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.858639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-61b3e662-4ec6-4c3d-a5f4-23f3521e72d4 None None] MFA Rules not processed for user `6bac7b20bdb348c09f0dd59abb7ae08b`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:43.860124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-61b3e662-4ec6-4c3d-a5f4-23f3521e72d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:43.873529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed7a40-39ba-4f7d-8b31-29e08287db72 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:43.890193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d479e-266a-4119-830e-65b0baaf0e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:43.892231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d479e-266a-4119-830e-65b0baaf0e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.892513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d479e-266a-4119-830e-65b0baaf0e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.892789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d479e-266a-4119-830e-65b0baaf0e2d admin admin] PATH_INFO: `/v3/projects/f6f5e721584744ad9f00163006cef710/users/f82a0374a3c8480885c8b6e721830dca/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.920958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d479e-266a-4119-830e-65b0baaf0e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f5e721584744ad9f00163006cef710, user_id=f82a0374a3c8480885c8b6e721830dca, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:43.928919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d479e-266a-4119-830e-65b0baaf0e2d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:43.941436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 887/1767] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:43.942418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e662-4ec6-4c3d-a5f4-23f3521e72d4 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:43.964970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 881/1768] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:43 2022] PUT /identity/v3/projects/f6f5e721584744ad9f00163006cef710/users/f82a0374a3c8480885c8b6e721830dca/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:43.966668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225849-df46-4320-973b-74d1a28c9d86 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:43.967061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225849-df46-4320-973b-74d1a28c9d86 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:43.967405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46225849-df46-4320-973b-74d1a28c9d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:43.997647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-46225849-df46-4320-973b-74d1a28c9d86 None None] MFA Rules not processed for user `f82a0374a3c8480885c8b6e721830dca`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:43.999677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-46225849-df46-4320-973b-74d1a28c9d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:44.038629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e662-4ec6-4c3d-a5f4-23f3521e72d4 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.102242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 882/1769] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:44.103756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674008-89b8-410e-8929-1059e6a50051 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.104109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674008-89b8-410e-8929-1059e6a50051 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.104384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674008-89b8-410e-8929-1059e6a50051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.125976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0187c9e3a5347b19f61d5e7d7f08074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03fa754827124ff5a1efaad8a31801be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.127672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.129207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.129526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.130364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:44.130702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.132437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.144764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2e674008-89b8-410e-8929-1059e6a50051 None None] MFA Rules not processed for user `011fa6cf9d534cd2a7e3d80326eec76f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:44.145994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2e674008-89b8-410e-8929-1059e6a50051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:44.154692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 888/1770] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:44.156377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.230678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 883/1771] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:44.236972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674008-89b8-410e-8929-1059e6a50051 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.248123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674008-89b8-410e-8929-1059e6a50051 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.253187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0187c9e3a5347b19f61d5e7d7f08074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03fa754827124ff5a1efaad8a31801be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.253865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.254786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.254786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.255349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.257297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.262364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44676-cf3b-495f-8e01-546d8bba4785 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.267488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.268166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.268795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.269068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.269774 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.272100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.309381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 889/1772] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:44 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:44.311027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 884/1773] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:44 2022] POST /identity/v3/projects => generated 355 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:44.314884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.316462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.408650 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0062-7992-4599-a4f6-fc52e633a041 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.440979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176e5b-4862-479d-aa0e-992fb6911642 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.445741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0187c9e3a5347b19f61d5e7d7f08074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03fa754827124ff5a1efaad8a31801be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.446440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.446729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.447149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.447891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:44.448201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.449824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.472221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 890/1774] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:44.504200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.505502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.505933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.506366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.507225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.509565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.535673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.543062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 885/1775] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:44 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:44.544214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.549768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150799-48ea-4453-b843-a19fe1c51740 tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.555505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ccde-95af-43b8-aa03-ce8590ef0b1a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.561084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.562304 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.562584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0187c9e3a5347b19f61d5e7d7f08074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03fa754827124ff5a1efaad8a31801be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.562716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.563045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.563471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.563766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.564015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.564128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] PATH_INFO: `/v3/projects/fd5928c14a04448499feaf41567e4153` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.565766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.567010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd5928c14a04448499feaf41567e4153)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.569962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.577854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 886/1776] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:44.582487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.595464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e08bb-0b5c-4f7d-8713-f00ff83c81d5 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.602608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.604127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.604501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.604876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.605713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.608135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.638334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 887/1777] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:44.642475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5928c14a04448499feaf41567e4153', 'request_id': 'req-daa57276-7534-4a97-b32b-a51564bc688b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:44.645906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:44.658015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5928c14a04448499feaf41567e4153', 'request_id': 'req-daa57276-7534-4a97-b32b-a51564bc688b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:44.670752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de258de-36dd-4f37-b892-db83fad9343e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:44.673997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5928c14a04448499feaf41567e4153', 'request_id': 'req-daa57276-7534-4a97-b32b-a51564bc688b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:44.701511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] The token cache is being invalidate because project fd5928c14a04448499feaf41567e4153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:44.701511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:44.702419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-daa57276-7534-4a97-b32b-a51564bc688b tempest-VolumeQuotaClassesTest-1664101612 tempest-VolumeQuotaClassesTest-1664101612-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:44.708042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 891/1778] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:44 2022] DELETE /identity/v3/projects/fd5928c14a04448499feaf41567e4153 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:44.808882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:44.810194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.810483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.810800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] PATH_INFO: `/v3/projects/10bff91fe488477fa331d8e4875e921d/users/722904b570a64aaf95e69220702e6e9c/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.831729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bff91fe488477fa331d8e4875e921d, user_id=722904b570a64aaf95e69220702e6e9c, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:44.834898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:44.875124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 888/1779] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:44 2022] PUT /identity/v3/projects/10bff91fe488477fa331d8e4875e921d/users/722904b570a64aaf95e69220702e6e9c/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:44.877423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:44.877718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:44.877989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:44.946114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] MFA Rules not processed for user `722904b570a64aaf95e69220702e6e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:44.948737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.097493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 892/1780] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:45.102112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.103905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.159519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.161138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.193219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cec31-d683-44cb-b8db-853bb9320764 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.205994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850246-881f-4ac6-b5b0-cb484b915690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.206820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850246-881f-4ac6-b5b0-cb484b915690 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.207100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850246-881f-4ac6-b5b0-cb484b915690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.207370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850246-881f-4ac6-b5b0-cb484b915690 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.208227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850246-881f-4ac6-b5b0-cb484b915690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.210215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850246-881f-4ac6-b5b0-cb484b915690 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.238579 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 889/1781] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:45 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:45.240074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702dc5-1689-419c-b2a8-41d07d45995b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.240424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702dc5-1689-419c-b2a8-41d07d45995b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.240757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702dc5-1689-419c-b2a8-41d07d45995b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.242869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 890/1782] 10.222.0.43 () {54 vars in 912 bytes} [Thu Mar 24 14:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:45.243639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4702dc5-1689-419c-b2a8-41d07d45995b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.279809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb60c4-4e13-4b58-97f1-2be810cf1eb6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.334023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4702dc5-1689-419c-b2a8-41d07d45995b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.341365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6473a-d534-4757-851e-f7d8c4e00852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.342867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6473a-d534-4757-851e-f7d8c4e00852 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.343382 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6473a-d534-4757-851e-f7d8c4e00852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.344429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6473a-d534-4757-851e-f7d8c4e00852 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.345976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6473a-d534-4757-851e-f7d8c4e00852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.349290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6473a-d534-4757-851e-f7d8c4e00852 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.354843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.355821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.356195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.356777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] PATH_INFO: `/v3/users/8dc1f990948746bb976eac2d8642300a` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.358249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc1f990948746bb976eac2d8642300a)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.360521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.374397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 891/1783] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:45 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:45.379336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83c06-53a7-48bb-8641-1a01939e5ba4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.379697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83c06-53a7-48bb-8641-1a01939e5ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.379984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83c06-53a7-48bb-8641-1a01939e5ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.414427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a4d83c06-53a7-48bb-8641-1a01939e5ba4 None None] MFA Rules not processed for user `750a6a7b35204c47ac16a584e7e71713`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:45.416420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a4d83c06-53a7-48bb-8641-1a01939e5ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.424698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc1f990948746bb976eac2d8642300a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:45.438363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc1f990948746bb976eac2d8642300a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:45.448162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc1f990948746bb976eac2d8642300a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:45.457656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc1f990948746bb976eac2d8642300a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:45.458916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc1f990948746bb976eac2d8642300a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:45.467977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 893/1784] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:45 2022] DELETE /identity/v3/users/8dc1f990948746bb976eac2d8642300a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:45.468920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.471965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.492721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 892/1785] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:45.494777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f117c-90cc-4ec2-a44a-59f6360214cb None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.495070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f117c-90cc-4ec2-a44a-59f6360214cb None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.495361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f117c-90cc-4ec2-a44a-59f6360214cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.515427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-180f117c-90cc-4ec2-a44a-59f6360214cb None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:45.516429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-180f117c-90cc-4ec2-a44a-59f6360214cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.560149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c86af-5e2b-4118-9183-48c133a13109 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.565681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.566466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.567292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.567576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.568306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.569921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.584102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 894/1786] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:45.584102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.587349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 893/1787] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:45.588249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f117c-90cc-4ec2-a44a-59f6360214cb None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.590598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.602503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f117c-90cc-4ec2-a44a-59f6360214cb None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.607363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.608275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.608585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.608964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] PATH_INFO: `/v3/projects/718c35ac46ba4a64b95c993e2c4eac47/users/0c4e8c4d31a445ecbde27a58b680aac4/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.623853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718c35ac46ba4a64b95c993e2c4eac47, user_id=0c4e8c4d31a445ecbde27a58b680aac4, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.626689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.640312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 894/1788] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:45 2022] PUT /identity/v3/projects/718c35ac46ba4a64b95c993e2c4eac47/users/0c4e8c4d31a445ecbde27a58b680aac4/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:45.641141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.644241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.646923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ea1d-ecc9-4b1b-8464-4ee49ff05533 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.694784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.695455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.695787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.696070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.703167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f893637-e8ac-4e54-9b2f-54264083e892 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.705031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.706597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.706948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdac7b4-2078-41fd-a69a-bb72f5fd53ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.707603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdac7b4-2078-41fd-a69a-bb72f5fd53ef service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.707885 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdac7b4-2078-41fd-a69a-bb72f5fd53ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.708161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdac7b4-2078-41fd-a69a-bb72f5fd53ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.715520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 895/1789] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:45.716297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.790572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c2adc-d947-427d-87d5-61c9d43161d6 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.797825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.798571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.798861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.799163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.799947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.801570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.807144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdac7b4-2078-41fd-a69a-bb72f5fd53ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.809108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdac7b4-2078-41fd-a69a-bb72f5fd53ef service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.817467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 896/1790] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:45.818501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:45.823330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 895/1791] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:45.830284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b85dc5-d5e8-4ca6-a8d1-e8b90cfcf422 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:45.835500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:45.836637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.836923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.837201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] PATH_INFO: `/v3/projects/718c35ac46ba4a64b95c993e2c4eac47/users/0c4e8c4d31a445ecbde27a58b680aac4/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.839298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=718c35ac46ba4a64b95c993e2c4eac47, user_id=0c4e8c4d31a445ecbde27a58b680aac4, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:45.841976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:45.853394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 897/1792] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:45 2022] PUT /identity/v3/projects/718c35ac46ba4a64b95c993e2c4eac47/users/0c4e8c4d31a445ecbde27a58b680aac4/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:45.864809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:45.866948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:45.867427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:45.908756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] MFA Rules not processed for user `0c4e8c4d31a445ecbde27a58b680aac4`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:45.910560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:45.999902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 896/1793] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:46.011596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:46.013440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:46.095938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e953c-1854-4b77-9ce2-aec36cdfd5aa admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:46.100692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:46.101383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:46.101673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:46.101951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:46.120067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:46.122517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:46.136233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:46.137757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:46.148770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 898/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:46.239167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547ee3-e4a4-4fa5-a40f-3ba3ce5c079d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:46.244921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:46.245866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:46.246246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:46.247199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] PATH_INFO: `/v3/projects/a1b059c1fcbc4ba7ac008f903e005f5e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:46.248815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b059c1fcbc4ba7ac008f903e005f5e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:46.252354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:46.345614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b059c1fcbc4ba7ac008f903e005f5e', 'request_id': 'req-a7267fb7-2512-452e-8556-f98b2309b494'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.357255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b059c1fcbc4ba7ac008f903e005f5e', 'request_id': 'req-a7267fb7-2512-452e-8556-f98b2309b494'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.368446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b059c1fcbc4ba7ac008f903e005f5e', 'request_id': 'req-a7267fb7-2512-452e-8556-f98b2309b494'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.393572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] The token cache is being invalidate because project a1b059c1fcbc4ba7ac008f903e005f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:46.393964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.394780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.397054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 897/1795] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:46 2022] DELETE /identity/v3/projects/a1b059c1fcbc4ba7ac008f903e005f5e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:46.400833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:46.416653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64943a99-9d24-4f59-a3a2-98c7f4e1853f service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:46.499622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:46.501032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:46.501423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:46.501854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] PATH_INFO: `/v3/users/c0187c9e3a5347b19f61d5e7d7f08074` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:46.503166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0187c9e3a5347b19f61d5e7d7f08074)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:46.505293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:46.573939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0187c9e3a5347b19f61d5e7d7f08074'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.594502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0187c9e3a5347b19f61d5e7d7f08074'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.604290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0187c9e3a5347b19f61d5e7d7f08074'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.628268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0187c9e3a5347b19f61d5e7d7f08074'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.628926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0187c9e3a5347b19f61d5e7d7f08074'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:46.641591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 899/1796] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:46 2022] DELETE /identity/v3/users/c0187c9e3a5347b19f61d5e7d7f08074 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:46.842535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:46.844186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:46.915203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7267fb7-2512-452e-8556-f98b2309b494 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:46.964007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d650f-721e-4417-b16b-50dc3dd94c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:46.964690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d650f-721e-4417-b16b-50dc3dd94c08 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:46.964982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d650f-721e-4417-b16b-50dc3dd94c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:46.965318 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d650f-721e-4417-b16b-50dc3dd94c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:46.967201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ee6d650f-721e-4417-b16b-50dc3dd94c08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:46.980163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:46.981902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:47.032957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d650f-721e-4417-b16b-50dc3dd94c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.034521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d650f-721e-4417-b16b-50dc3dd94c08 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.043928 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 898/1797] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:53:47.050845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c09f-49d6-49e2-b72d-e853fb738140 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:47.055468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:47.056288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.056570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.056840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] PATH_INFO: `/v3/projects/03fa754827124ff5a1efaad8a31801be` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.058002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fa754827124ff5a1efaad8a31801be)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.059921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.110940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fa754827124ff5a1efaad8a31801be', 'request_id': 'req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:47.119097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fa754827124ff5a1efaad8a31801be', 'request_id': 'req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:47.124828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fa754827124ff5a1efaad8a31801be', 'request_id': 'req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:47.136510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] The token cache is being invalidate because project 03fa754827124ff5a1efaad8a31801be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:47.136948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:47.137804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-09dd730d-cb3c-40a4-b6e1-1f7572d12e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:47.143318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 900/1798] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:46 2022] DELETE /identity/v3/projects/03fa754827124ff5a1efaad8a31801be => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:47.144622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54cc9c-7b8a-4212-af07-a1ff708fb555 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.145043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54cc9c-7b8a-4212-af07-a1ff708fb555 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.145455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54cc9c-7b8a-4212-af07-a1ff708fb555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.163540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-8c54cc9c-7b8a-4212-af07-a1ff708fb555 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:47.164680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8c54cc9c-7b8a-4212-af07-a1ff708fb555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:47.235857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 899/1799] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:47.243567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ac9e-009c-4ce1-bb66-a79d65e39ce1 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.243850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ac9e-009c-4ce1-bb66-a79d65e39ce1 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.244127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740ac9e-009c-4ce1-bb66-a79d65e39ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.264279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2740ac9e-009c-4ce1-bb66-a79d65e39ce1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:47.265733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2740ac9e-009c-4ce1-bb66-a79d65e39ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:47.277024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 901/1800] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:47.281690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54cc9c-7b8a-4212-af07-a1ff708fb555 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:47.296734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54cc9c-7b8a-4212-af07-a1ff708fb555 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:47.310955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:47.313503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.313770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.314030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.314887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:47.315193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.316831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.329512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 900/1801] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:53:47.334155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740ac9e-009c-4ce1-bb66-a79d65e39ce1 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:47.343273 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740ac9e-009c-4ce1-bb66-a79d65e39ce1 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:47.350254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:47.350931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.351214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.351640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.352352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.354278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.380272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 902/1802] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:47 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:47.384892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:47.394910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aac442-1c75-4510-8cf4-4784e0c6b71b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:47.451659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:47.452329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.452638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.452913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.453643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.455933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.480874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 901/1803] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:47 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:47.485173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:47.496493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4930c6e-005d-4006-b696-241a1329e27e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:47.502289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:47.503067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.503358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.503637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.504378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.506214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.519461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 903/1804] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:47.523414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:47.533770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ef290-849d-4469-a3a2-fc918e752fe8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:47.538830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6b091-7c38-4fcc-b325-512a8348deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:47.539498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6b091-7c38-4fcc-b325-512a8348deb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.539779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6b091-7c38-4fcc-b325-512a8348deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.540054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6b091-7c38-4fcc-b325-512a8348deb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.541116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6b091-7c38-4fcc-b325-512a8348deb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.542433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6b091-7c38-4fcc-b325-512a8348deb0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.553508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 902/1805] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:47.558008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:47.568803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838282e2-fcfb-4d1c-b41b-492af6dec557 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:47.573936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:47.574862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.575171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.575590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] PATH_INFO: `/v3/projects/a4fe6bf8427f43d9a531c806a3ca286a/users/68a367a824564ea3bd6f86781a9fb34c/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.609259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fe6bf8427f43d9a531c806a3ca286a, user_id=68a367a824564ea3bd6f86781a9fb34c, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:47.612693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:47.637909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 904/1806] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:47 2022] PUT /identity/v3/projects/a4fe6bf8427f43d9a531c806a3ca286a/users/68a367a824564ea3bd6f86781a9fb34c/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:47.641042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84336456-1e11-4bd9-b1f7-f6244bc4ef42 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:47.641505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84336456-1e11-4bd9-b1f7-f6244bc4ef42 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:47.642029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84336456-1e11-4bd9-b1f7-f6244bc4ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:47.713866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-84336456-1e11-4bd9-b1f7-f6244bc4ef42 None None] MFA Rules not processed for user `68a367a824564ea3bd6f86781a9fb34c`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:47.718459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-84336456-1e11-4bd9-b1f7-f6244bc4ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:47.908044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 903/1807] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:47.912695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:48.022786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308cca8-9b03-4fe7-b0de-e077dc5301b2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:48.030002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:48.031074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.031526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.032004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.032860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:48.035397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:48.082785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 905/1808] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:47 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:48.087900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84336456-1e11-4bd9-b1f7-f6244bc4ef42 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:48.116717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84336456-1e11-4bd9-b1f7-f6244bc4ef42 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:48.218967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:48.219651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.219929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.220205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.222000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:48.224978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:48.252843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 904/1809] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:48 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:48.256814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:48.268770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c9e7d-949d-400b-94cc-e98f87b443fb admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:48.274697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:48.275477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.275691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.275958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.276736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:48.278434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:48.292928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 906/1810] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:48.294474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:48.306995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4912ee-2a9b-4b7b-b7cb-86608809311e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:48.315973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:48.318226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.318644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.319059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] PATH_INFO: `/v3/projects/f3a334a65ded4822a5703dc08d7db327/users/6c911992f7974699935d0bf76353f5fc/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.353673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a334a65ded4822a5703dc08d7db327, user_id=6c911992f7974699935d0bf76353f5fc, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:48.358175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:48.389697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 905/1811] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:48 2022] PUT /identity/v3/projects/f3a334a65ded4822a5703dc08d7db327/users/6c911992f7974699935d0bf76353f5fc/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:48.394461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:48.408500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb7c1c-1e58-4768-8f46-b2fc8283ea23 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:48.471652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2538806-60cc-42c7-aa32-e89c8ce3c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:48.472429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2538806-60cc-42c7-aa32-e89c8ce3c288 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.472777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2538806-60cc-42c7-aa32-e89c8ce3c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.473110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2538806-60cc-42c7-aa32-e89c8ce3c288 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.473899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2538806-60cc-42c7-aa32-e89c8ce3c288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:48.475942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2538806-60cc-42c7-aa32-e89c8ce3c288 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:48.490115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 907/1812] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:48.491362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:48.512970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6cf05-b789-4b28-86cf-18f3c0d9a086 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:48.518587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:48.519586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.520645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.521293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] PATH_INFO: `/v3/projects/f3a334a65ded4822a5703dc08d7db327/users/6c911992f7974699935d0bf76353f5fc/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.523211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a334a65ded4822a5703dc08d7db327, user_id=6c911992f7974699935d0bf76353f5fc, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:48.525895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:48.549713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 906/1813] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:48 2022] PUT /identity/v3/projects/f3a334a65ded4822a5703dc08d7db327/users/6c911992f7974699935d0bf76353f5fc/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:48.552707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a9c3-c5b6-488e-bd9e-2bbd0d78b1fa None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.553102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a9c3-c5b6-488e-bd9e-2bbd0d78b1fa None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.553453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656a9c3-c5b6-488e-bd9e-2bbd0d78b1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.627001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f656a9c3-c5b6-488e-bd9e-2bbd0d78b1fa None None] MFA Rules not processed for user `6c911992f7974699935d0bf76353f5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:48.628540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f656a9c3-c5b6-488e-bd9e-2bbd0d78b1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:48.749713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 908/1814] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:48.776022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:48.777791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:48.915787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f555e3-455b-4491-8528-c4011a46abd4 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:48.940496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76ef0e-530a-4b03-adf7-a4173b7b0c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:48.941485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76ef0e-530a-4b03-adf7-a4173b7b0c3b service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:48.942344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76ef0e-530a-4b03-adf7-a4173b7b0c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:48.942980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76ef0e-530a-4b03-adf7-a4173b7b0c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:48.960731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76ef0e-530a-4b03-adf7-a4173b7b0c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:48.965122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76ef0e-530a-4b03-adf7-a4173b7b0c3b service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:48.997792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 907/1815] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:50.601967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656a9c3-c5b6-488e-bd9e-2bbd0d78b1fa None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:50.723425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656a9c3-c5b6-488e-bd9e-2bbd0d78b1fa None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:50.731294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:50.732455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:50.732834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:50.734014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] PATH_INFO: `/v3/users/68a367a824564ea3bd6f86781a9fb34c` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:50.735652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a367a824564ea3bd6f86781a9fb34c)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:50.738329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:50.832594 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a367a824564ea3bd6f86781a9fb34c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:50.854408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a367a824564ea3bd6f86781a9fb34c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:50.867718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a367a824564ea3bd6f86781a9fb34c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:50.878940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a367a824564ea3bd6f86781a9fb34c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:50.879690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a367a824564ea3bd6f86781a9fb34c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:50.895827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 909/1816] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:50 2022] DELETE /identity/v3/users/68a367a824564ea3bd6f86781a9fb34c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:50.896122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb6b6-b2c7-42d9-b268-bf8833f92c90 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:50.896920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb6b6-b2c7-42d9-b268-bf8833f92c90 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:50.897234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb6b6-b2c7-42d9-b268-bf8833f92c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:50.928408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-fcbeb6b6-b2c7-42d9-b268-bf8833f92c90 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:50.933366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fcbeb6b6-b2c7-42d9-b268-bf8833f92c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:51.020087 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 908/1817] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:51.187298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:51.188976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:51.327535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712510af-1d27-4630-857d-b67a2eb2f395 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:51.331779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99b21-ac39-471b-8a1c-f02c9f5f4ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:51.332453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99b21-ac39-471b-8a1c-f02c9f5f4ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:51.332740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99b21-ac39-471b-8a1c-f02c9f5f4ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:51.333019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99b21-ac39-471b-8a1c-f02c9f5f4ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:51.358154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b99b21-ac39-471b-8a1c-f02c9f5f4ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:51.359671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b99b21-ac39-471b-8a1c-f02c9f5f4ee3 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:51.383554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 910/1818] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:51.391465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b960d-668f-474f-82b9-709574c8d606 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:51.391759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b960d-668f-474f-82b9-709574c8d606 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:51.392047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b960d-668f-474f-82b9-709574c8d606 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:51.399924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 909/1819] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:53:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:51.434579 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:51.434880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:51.435154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:51.469597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:51.470870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:51.678163 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 911/1820] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:51.788359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b960d-668f-474f-82b9-709574c8d606 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:51.790665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-cd0b960d-668f-474f-82b9-709574c8d606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:51.827756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b960d-668f-474f-82b9-709574c8d606 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:51.843857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:51.845800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:51.846266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:51.846973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:51.861244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:51.864039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:51.916370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 910/1821] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:52.116568 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:52.118547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:52.237058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968f376-48cf-4237-ab8b-b35e76ef896e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:52.241107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:52.241760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:52.242065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:52.242368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:52.245674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:52.315220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:52.316865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:52.328263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 912/1822] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:53.031292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:53.034894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:53.076349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071eea8d-30d4-470e-b89d-f5168e8338a2 service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:53.093720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:53.109760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:53.110351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:53.111196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] PATH_INFO: `/v3/projects/a4fe6bf8427f43d9a531c806a3ca286a` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:53.114477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fe6bf8427f43d9a531c806a3ca286a)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:53.117725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:53.264952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fe6bf8427f43d9a531c806a3ca286a', 'request_id': 'req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.288857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fe6bf8427f43d9a531c806a3ca286a', 'request_id': 'req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.302548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fe6bf8427f43d9a531c806a3ca286a', 'request_id': 'req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.325592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] The token cache is being invalidate because project a4fe6bf8427f43d9a531c806a3ca286a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:53.327171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.329505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d6662033-c368-4fbb-8dd7-b8bb2bd47f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.339232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 911/1823] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:53 2022] DELETE /identity/v3/projects/a4fe6bf8427f43d9a531c806a3ca286a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:53.346881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:53.361443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad721529-7945-4209-b76f-00fe629401ea service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:53.552310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:53.553236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:53.554520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:53.555620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] PATH_INFO: `/v3/users/6c911992f7974699935d0bf76353f5fc` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:53.558531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c911992f7974699935d0bf76353f5fc)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:53.562126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:53.702705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c911992f7974699935d0bf76353f5fc'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.747117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c911992f7974699935d0bf76353f5fc'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.762120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c911992f7974699935d0bf76353f5fc'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.781577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c911992f7974699935d0bf76353f5fc'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.782439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0d52fd0c-8691-4488-8007-55fc98d9111c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c911992f7974699935d0bf76353f5fc'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:53.792370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 913/1824] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:53 2022] DELETE /identity/v3/users/6c911992f7974699935d0bf76353f5fc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:53.927717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb560b3-d910-43ba-8c31-1ab6b0207b25 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:53.928613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb560b3-d910-43ba-8c31-1ab6b0207b25 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:53.928613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb560b3-d910-43ba-8c31-1ab6b0207b25 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:53.930363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 912/1825] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:53:53.980757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:53.981068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:53.981347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:54.019372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:54.026243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:54.181213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 914/1826] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:53:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:54.364758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb560b3-d910-43ba-8c31-1ab6b0207b25 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:54.367166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2cb560b3-d910-43ba-8c31-1ab6b0207b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:54.391351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb560b3-d910-43ba-8c31-1ab6b0207b25 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:54.398119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007c034-16a8-4fae-97df-ebe3918f900c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:54.398920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c034-16a8-4fae-97df-ebe3918f900c service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:54.399433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c034-16a8-4fae-97df-ebe3918f900c service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:54.399866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007c034-16a8-4fae-97df-ebe3918f900c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:54.410766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c034-16a8-4fae-97df-ebe3918f900c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:54.412543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007c034-16a8-4fae-97df-ebe3918f900c service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:54.446204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 913/1827] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:54.880760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:54.883544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.083070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cdadf-45ed-4196-b017-b1763389b17a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.088161 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.089020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.089439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.089954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] PATH_INFO: `/v3/projects/f3a334a65ded4822a5703dc08d7db327` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.091333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a334a65ded4822a5703dc08d7db327)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.093840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.142882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a334a65ded4822a5703dc08d7db327', 'request_id': 'req-54941661-8e64-4cb2-9685-c14b59017c95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.151455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a334a65ded4822a5703dc08d7db327', 'request_id': 'req-54941661-8e64-4cb2-9685-c14b59017c95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.158025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a334a65ded4822a5703dc08d7db327', 'request_id': 'req-54941661-8e64-4cb2-9685-c14b59017c95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.169194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] The token cache is being invalidate because project f3a334a65ded4822a5703dc08d7db327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:55.169495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.170189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54941661-8e64-4cb2-9685-c14b59017c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.171819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 915/1828] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:54 2022] DELETE /identity/v3/projects/f3a334a65ded4822a5703dc08d7db327 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:55.177471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08bf02-5f35-453b-abff-5a0421546e25 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.177855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08bf02-5f35-453b-abff-5a0421546e25 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.178240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08bf02-5f35-453b-abff-5a0421546e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.198266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7d08bf02-5f35-453b-abff-5a0421546e25 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:55.199487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7d08bf02-5f35-453b-abff-5a0421546e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.285924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 914/1829] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:55.294259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.294848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.295344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.347551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:55.349084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.378075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 916/1830] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:55.383481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08bf02-5f35-453b-abff-5a0421546e25 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.398305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08bf02-5f35-453b-abff-5a0421546e25 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.409360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.409360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.409360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.409669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.410812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:55.411390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.413652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.427377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.429291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.433392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 915/1831] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:55.437481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.442633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217f9ce-ec17-400d-8dd4-1d935ca35e08 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.448583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e40c-e86a-446c-8e65-62ec58c843df admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.449051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.450200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.450471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.450886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] PATH_INFO: `/v3/users/f82a0374a3c8480885c8b6e721830dca` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.452097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82a0374a3c8480885c8b6e721830dca)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.453780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.454311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.454488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.455273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.455561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.456258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.458226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.487469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 916/1832] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:55 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:55.491892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.519511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82a0374a3c8480885c8b6e721830dca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.534599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82a0374a3c8480885c8b6e721830dca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.541999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82a0374a3c8480885c8b6e721830dca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.552253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82a0374a3c8480885c8b6e721830dca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.553036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a8ed46f8-51ab-4355-bef1-c90b620d5e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82a0374a3c8480885c8b6e721830dca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:55.559363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 917/1833] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:55 2022] DELETE /identity/v3/users/f82a0374a3c8480885c8b6e721830dca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:55.563793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.564315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.564741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.570682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3122fd-c17b-4324-b79b-639495d9d619 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.587039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:55.588289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.649370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.650332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.650786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.651299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.652225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.654631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.674458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 918/1834] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:55.692178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.695120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 917/1835] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:55 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:55.695845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.696115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.699205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.716142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bbdb2-0445-4908-b658-652115d9c036 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.722309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.723034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.723318 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.723588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.724402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.727232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.746630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 918/1836] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:55.749189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.765308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2daa-7fba-4245-b2f4-70ee92f099b4 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.773957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.775142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.775565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.776020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.776999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.779847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.782777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae6c3-e905-4f61-bb15-cca36efde9da None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.790802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6b1e-8d09-46e5-a0d1-70766ffbf89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.791520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6b1e-8d09-46e5-a0d1-70766ffbf89f service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.800647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6b1e-8d09-46e5-a0d1-70766ffbf89f service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.800647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6b1e-8d09-46e5-a0d1-70766ffbf89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.800868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 919/1837] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:55.800868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:55.805276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6b1e-8d09-46e5-a0d1-70766ffbf89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.806753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6b1e-8d09-46e5-a0d1-70766ffbf89f service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.807058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95ad6-c28e-4a34-a1a1-6210cf4c6d44 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:55.812163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:55.813045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.813327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.813603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] PATH_INFO: `/v3/projects/327a054ec25a48698ccb138135206830/users/28a49f9a45b8416ba9ee376f2894494a/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.818837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 919/1838] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:55.830848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327a054ec25a48698ccb138135206830, user_id=28a49f9a45b8416ba9ee376f2894494a, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:55.833637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:55.848327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 920/1839] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:55 2022] PUT /identity/v3/projects/327a054ec25a48698ccb138135206830/users/28a49f9a45b8416ba9ee376f2894494a/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:55.858696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749841b0-8828-4bee-8a68-2e6767c61c44 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:55.859351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749841b0-8828-4bee-8a68-2e6767c61c44 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:55.859776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749841b0-8828-4bee-8a68-2e6767c61c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:55.893778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-749841b0-8828-4bee-8a68-2e6767c61c44 None None] MFA Rules not processed for user `28a49f9a45b8416ba9ee376f2894494a`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:55.895541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-749841b0-8828-4bee-8a68-2e6767c61c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:55.972608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 920/1840] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:55.977343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.044945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067de84-fd53-4e8b-b652-25cb52e919e9 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.049506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.050196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.050480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.050815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.051441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.053319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.089853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 921/1841] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:55 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:56.094492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749841b0-8828-4bee-8a68-2e6767c61c44 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.106838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749841b0-8828-4bee-8a68-2e6767c61c44 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.120175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.122560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:56.190509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.191447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.191833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.192366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.193170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.195239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.214127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be9a75-2b0b-4f09-ba71-efd681372f3c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.219545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.220423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.220702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.220973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] PATH_INFO: `/v3/projects/f6f5e721584744ad9f00163006cef710` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.222281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f5e721584744ad9f00163006cef710)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.224600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.225507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 921/1842] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:56 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:56.229351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.244260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf96e7-bab8-47be-aef4-dd8b1f0eea98 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.258667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.259385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.259615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.259889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.260618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.262247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.275628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 922/1843] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:56.276707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.282997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f5e721584744ad9f00163006cef710', 'request_id': 'req-50457991-0eda-4bbf-b4e0-2f3159265f6e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.286918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cda0b-ea09-4bcf-a41a-0032db527d2d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.291860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f5e721584744ad9f00163006cef710', 'request_id': 'req-50457991-0eda-4bbf-b4e0-2f3159265f6e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.297468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f5e721584744ad9f00163006cef710', 'request_id': 'req-50457991-0eda-4bbf-b4e0-2f3159265f6e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.309237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] The token cache is being invalidate because project f6f5e721584744ad9f00163006cef710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:56.309526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.310370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.312067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 922/1844] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:56 2022] DELETE /identity/v3/projects/f6f5e721584744ad9f00163006cef710 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:56.317485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.318956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:56.361528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.362467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.362752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.363056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] PATH_INFO: `/v3/projects/512f76e61e0246619fc88ebf2453d9bb/users/9ff18238a909489a864b1f82c4f61561/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.384558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] RBAC: Authorizing `identity:create_grant(project_id=512f76e61e0246619fc88ebf2453d9bb, user_id=9ff18238a909489a864b1f82c4f61561, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.387494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.407282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 923/1845] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:56 2022] PUT /identity/v3/projects/512f76e61e0246619fc88ebf2453d9bb/users/9ff18238a909489a864b1f82c4f61561/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:56.408225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.410025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:56.410455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457991-0eda-4bbf-b4e0-2f3159265f6e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.485290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3df54-5c29-4b30-814a-1918fad4915d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.488779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.490482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.490621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.490877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.491160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] PATH_INFO: `/v3/users/722904b570a64aaf95e69220702e6e9c` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.491840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.491840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.491840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.492835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722904b570a64aaf95e69220702e6e9c)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.492975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.494514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.495779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.507220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 924/1846] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:56.511154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.524307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64697f-d5e8-4808-9973-38e704069080 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.532014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbc76f-f7a3-4c85-99a2-dc6c2371d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.533807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc76f-f7a3-4c85-99a2-dc6c2371d72c admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.534417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc76f-f7a3-4c85-99a2-dc6c2371d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.534826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc76f-f7a3-4c85-99a2-dc6c2371d72c admin admin] PATH_INFO: `/v3/projects/512f76e61e0246619fc88ebf2453d9bb/users/9ff18238a909489a864b1f82c4f61561/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.537254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbc76f-f7a3-4c85-99a2-dc6c2371d72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=512f76e61e0246619fc88ebf2453d9bb, user_id=9ff18238a909489a864b1f82c4f61561, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.540781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbc76f-f7a3-4c85-99a2-dc6c2371d72c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.566239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 925/1847] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:56 2022] PUT /identity/v3/projects/512f76e61e0246619fc88ebf2453d9bb/users/9ff18238a909489a864b1f82c4f61561/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:56.569983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.570284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.570517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.591796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722904b570a64aaf95e69220702e6e9c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.601974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722904b570a64aaf95e69220702e6e9c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.603141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722904b570a64aaf95e69220702e6e9c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.603982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722904b570a64aaf95e69220702e6e9c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.614801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] MFA Rules not processed for user `9ff18238a909489a864b1f82c4f61561`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:56.616860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:56.621123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722904b570a64aaf95e69220702e6e9c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:56.641254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 923/1848] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:56 2022] DELETE /identity/v3/users/722904b570a64aaf95e69220702e6e9c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:56.720014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 926/1849] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:56.731837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.733570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:56.793104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d748d-ff64-4d3b-a65a-46307643ca93 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:56.796979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:56.797626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:56.797903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:56.798361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:56.861874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:56.863478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:56.873765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 924/1850] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:56.964347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:56.965904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.058555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7bf07-5030-4419-838b-b7e99831b23c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:57.133173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:57.133988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.134296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.134566 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] PATH_INFO: `/v3/projects/10bff91fe488477fa331d8e4875e921d` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.135732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bff91fe488477fa331d8e4875e921d)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:57.137681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:57.183935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bff91fe488477fa331d8e4875e921d', 'request_id': 'req-9dc516d5-b2dd-466e-9191-1a4f171ae185'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.192219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bff91fe488477fa331d8e4875e921d', 'request_id': 'req-9dc516d5-b2dd-466e-9191-1a4f171ae185'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.197840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bff91fe488477fa331d8e4875e921d', 'request_id': 'req-9dc516d5-b2dd-466e-9191-1a4f171ae185'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.208932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] The token cache is being invalidate because project 10bff91fe488477fa331d8e4875e921d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:57.209221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.210182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.215076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 927/1851] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:56 2022] DELETE /identity/v3/projects/10bff91fe488477fa331d8e4875e921d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:57.218903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:57.229526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca912990-e03f-41b7-a675-79e3877c932c service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:57.291112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:57.291927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:57.292652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.292823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.293071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.293476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] PATH_INFO: `/v3/users/0c4e8c4d31a445ecbde27a58b680aac4` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.294743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4e8c4d31a445ecbde27a58b680aac4)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:57.296677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:57.305482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc516d5-b2dd-466e-9191-1a4f171ae185 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:57.310752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:57.311723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.312006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.312287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] PATH_INFO: `/v3/users/28a49f9a45b8416ba9ee376f2894494a` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.313496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a49f9a45b8416ba9ee376f2894494a)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:57.315460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:57.349753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4e8c4d31a445ecbde27a58b680aac4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.358773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4e8c4d31a445ecbde27a58b680aac4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.359501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4e8c4d31a445ecbde27a58b680aac4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.360123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4e8c4d31a445ecbde27a58b680aac4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.367901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a49f9a45b8416ba9ee376f2894494a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.372119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-eaf0e860-cddf-41a7-8655-ea5211e0aaf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4e8c4d31a445ecbde27a58b680aac4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.381053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a49f9a45b8416ba9ee376f2894494a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.386967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 925/1852] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:57 2022] DELETE /identity/v3/users/0c4e8c4d31a445ecbde27a58b680aac4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:57.389223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a49f9a45b8416ba9ee376f2894494a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.399539 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a49f9a45b8416ba9ee376f2894494a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.400903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a49f9a45b8416ba9ee376f2894494a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.408090 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 928/1853] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:57 2022] DELETE /identity/v3/users/28a49f9a45b8416ba9ee376f2894494a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:57.413321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15794-a129-429b-923b-640221b47869 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.413823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15794-a129-429b-923b-640221b47869 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.414317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15794-a129-429b-923b-640221b47869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.433236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-70b15794-a129-429b-923b-640221b47869 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:57.434519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-70b15794-a129-429b-923b-640221b47869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.495387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 926/1854] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:57.505818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:57.507449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.566663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8923e2-e598-4bcd-b641-6fd8afa6d571 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:57.570419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd060ec3-d055-4d49-a6d5-789b4e57e390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:57.571088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd060ec3-d055-4d49-a6d5-789b4e57e390 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.571366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd060ec3-d055-4d49-a6d5-789b4e57e390 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.571631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd060ec3-d055-4d49-a6d5-789b4e57e390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.581259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd060ec3-d055-4d49-a6d5-789b4e57e390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:57.582761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd060ec3-d055-4d49-a6d5-789b4e57e390 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:57.592505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 929/1855] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:53:57.708015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15794-a129-429b-923b-640221b47869 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:57.710053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-70b15794-a129-429b-923b-640221b47869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.722849 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15794-a129-429b-923b-640221b47869 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:57.740205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:57.741097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.741377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.741653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] PATH_INFO: `/v3/projects/718c35ac46ba4a64b95c993e2c4eac47` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.744734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718c35ac46ba4a64b95c993e2c4eac47)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:57.746880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:57.820818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718c35ac46ba4a64b95c993e2c4eac47', 'request_id': 'req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.832325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718c35ac46ba4a64b95c993e2c4eac47', 'request_id': 'req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.838688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718c35ac46ba4a64b95c993e2c4eac47', 'request_id': 'req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.849791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] The token cache is being invalidate because project 718c35ac46ba4a64b95c993e2c4eac47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:57.850230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.851000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:57.852607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 927/1856] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:57 2022] DELETE /identity/v3/projects/718c35ac46ba4a64b95c993e2c4eac47 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:57.859697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c968184-8fcb-4351-9a43-ed04bda2d261 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.859985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c968184-8fcb-4351-9a43-ed04bda2d261 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.860262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c968184-8fcb-4351-9a43-ed04bda2d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.879968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9c968184-8fcb-4351-9a43-ed04bda2d261 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:57.881049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9c968184-8fcb-4351-9a43-ed04bda2d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.915142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:57.916994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.939122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 930/1857] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:57.947550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa369-732e-4658-9b9b-1a7a310905c5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.948071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa369-732e-4658-9b9b-1a7a310905c5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.948347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa369-732e-4658-9b9b-1a7a310905c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.966898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ae9fa369-732e-4658-9b9b-1a7a310905c5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:57.968130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ae9fa369-732e-4658-9b9b-1a7a310905c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:57.975832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 931/1858] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:57.979914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa369-732e-4658-9b9b-1a7a310905c5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:57.984072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547cbee-a3ed-49e0-ae8e-110c3ac41ec9 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:57.988460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa369-732e-4658-9b9b-1a7a310905c5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:57.988593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:57.989437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.989716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.989987 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] PATH_INFO: `/v3/projects/327a054ec25a48698ccb138135206830` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.991196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327a054ec25a48698ccb138135206830)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:57.992911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:57.993168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:57.993541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:57.993819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:57.994108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:57.994897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:57.995195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:57.996798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.008754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 932/1859] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:53:58.012933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.023040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641215-bed2-4e12-ad96-4aef9da951c8 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.028614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.029387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.029675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.029944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.030855 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.032957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.041661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327a054ec25a48698ccb138135206830', 'request_id': 'req-8388c210-4d77-49b5-bdb0-3beb605379b9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.051422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327a054ec25a48698ccb138135206830', 'request_id': 'req-8388c210-4d77-49b5-bdb0-3beb605379b9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.058492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327a054ec25a48698ccb138135206830', 'request_id': 'req-8388c210-4d77-49b5-bdb0-3beb605379b9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.065724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 933/1860] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:58 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:58.066809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.070379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] The token cache is being invalidate because project 327a054ec25a48698ccb138135206830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:58.070667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.071367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.073357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 928/1861] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:57 2022] DELETE /identity/v3/projects/327a054ec25a48698ccb138135206830 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:58.077103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.078693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:58.133764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09645-6af3-4914-b636-e469c3c792a3 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.146346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388c210-4d77-49b5-bdb0-3beb605379b9 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.148431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.149681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.150159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.150494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.151353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.151567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.152493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.152776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.153510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] PATH_INFO: `/v3/users/9ff18238a909489a864b1f82c4f61561` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.153628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.154335 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff18238a909489a864b1f82c4f61561)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.156535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.181287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 934/1862] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:58 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:58.185518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.187736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:58.201179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc76b8-c898-4908-bf9a-5ebdf64172c8 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.206397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.207069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.207348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.207618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.208366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.209956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.222286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff18238a909489a864b1f82c4f61561'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.223165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 935/1863] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:58.224048 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.233134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff18238a909489a864b1f82c4f61561'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.233890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff18238a909489a864b1f82c4f61561'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.234570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff18238a909489a864b1f82c4f61561'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.236717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3c8c6-f529-44d4-b91e-43517e42002f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.241465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.242288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.242644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.242992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.243966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.245651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.246373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-206626de-d1a7-4feb-bf1d-7be2aa440c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff18238a909489a864b1f82c4f61561'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.256583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 936/1864] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:58.260523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.262356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:58.263006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 929/1865] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:53:58 2022] DELETE /identity/v3/users/9ff18238a909489a864b1f82c4f61561 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:58.276685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd315b0-fd85-4aee-89e8-e427c55af09a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.358709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.359729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.360176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.360540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] PATH_INFO: `/v3/projects/892e45a4f8b44b5395273732d6371050/users/0ef59d7cf6354a768ae0ec0d02d7a0ed/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.390651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=892e45a4f8b44b5395273732d6371050, user_id=0ef59d7cf6354a768ae0ec0d02d7a0ed, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.393380 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.413878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 937/1866] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:58 2022] PUT /identity/v3/projects/892e45a4f8b44b5395273732d6371050/users/0ef59d7cf6354a768ae0ec0d02d7a0ed/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:58.425656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.426178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.426274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.460247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] MFA Rules not processed for user `0ef59d7cf6354a768ae0ec0d02d7a0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:58.461765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:58.569479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 930/1867] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:58.574468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.621855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.625857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:58.789817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d2529-a2da-43f0-a158-25dd6f8c6b91 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.795283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.796529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.797122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.797408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] PATH_INFO: `/v3/projects/512f76e61e0246619fc88ebf2453d9bb` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.798682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512f76e61e0246619fc88ebf2453d9bb)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.800560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.820390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52963-ebc0-4093-99cd-edbd417cc65b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:58.875720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:58.876650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:58.877060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:58.877462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:58.878336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:58.885798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:58.937657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 938/1868] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:58 2022] POST /identity/v3/projects => generated 365 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:53:58.941696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:58.962640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512f76e61e0246619fc88ebf2453d9bb', 'request_id': 'req-cf661222-2405-4232-bb56-ca1bb483af43'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.974667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512f76e61e0246619fc88ebf2453d9bb', 'request_id': 'req-cf661222-2405-4232-bb56-ca1bb483af43'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.983542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512f76e61e0246619fc88ebf2453d9bb', 'request_id': 'req-cf661222-2405-4232-bb56-ca1bb483af43'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:58.997397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] The token cache is being invalidate because project 512f76e61e0246619fc88ebf2453d9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:53:58.997981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:59.000395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-cf661222-2405-4232-bb56-ca1bb483af43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:53:59.003775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 931/1869] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:53:58 2022] DELETE /identity/v3/projects/512f76e61e0246619fc88ebf2453d9bb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:53:59.009069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3dd3-2db3-4762-83e4-923fc331e314 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.009547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3dd3-2db3-4762-83e4-923fc331e314 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.010038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3dd3-2db3-4762-83e4-923fc331e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.058956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2cdb3dd3-2db3-4762-83e4-923fc331e314 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:59.063116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2cdb3dd3-2db3-4762-83e4-923fc331e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:59.068255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908ab7b-074c-4c87-9e22-ca793e05d08c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.073569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 932/1870] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:59.081542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6629e-9993-4d84-9f99-d8b9a7d6ea25 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.082721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6629e-9993-4d84-9f99-d8b9a7d6ea25 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.083302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6629e-9993-4d84-9f99-d8b9a7d6ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.084561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.085258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.085687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.085975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.086703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.088841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.130196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 939/1871] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:58 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:59.133805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.134008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c7d6629e-9993-4d84-9f99-d8b9a7d6ea25 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:59.135521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:59.136395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c7d6629e-9993-4d84-9f99-d8b9a7d6ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:59.158224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 933/1872] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:53:59.161562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6629e-9993-4d84-9f99-d8b9a7d6ea25 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.165776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256d55f-6e00-44e4-b3b7-71bc35811b0a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.177523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.178246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.178530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.179269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.179587 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.180792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6629e-9993-4d84-9f99-d8b9a7d6ea25 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.181195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.195254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.197210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.197704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.198390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.200381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:53:59.201522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.205014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.208571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 940/1873] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:53:59.212614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.232511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 934/1874] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:53:59.233837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.234399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c871042-b7a0-471c-bd54-ce8323f67dc7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.248961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf816b-ba1a-4e21-83e0-992576eec2ea admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.255213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.256316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.256609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.257016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] PATH_INFO: `/v3/projects/6825f42c5b1041fa9d2610da32ed6c36/users/50c3e58b68204eb5bc33d937ddb2663f/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.259460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.260432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.260798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.261166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.262228 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.267007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.293238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6825f42c5b1041fa9d2610da32ed6c36, user_id=50c3e58b68204eb5bc33d937ddb2663f, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.296727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.316976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 935/1875] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:53:59 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:59.317599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.318977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 941/1876] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:59 2022] PUT /identity/v3/projects/6825f42c5b1041fa9d2610da32ed6c36/users/50c3e58b68204eb5bc33d937ddb2663f/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:59.323316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.408452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ba35c-ea8c-4da6-9b16-cdc97f90343a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.410229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064dc9-2aaf-422f-bdce-a240ba0fe2b0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.413966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.414711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.414993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.415270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.415963 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.417891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.424379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.425310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.425730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.426191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.427067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.429429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.441081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 936/1877] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:53:59 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:53:59.444978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.457953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00978950-6679-4a24-9e31-1421a84455b8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.467271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.468105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.468385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.468658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.468829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 942/1878] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:59.469395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.471019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.473021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.494420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 937/1879] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:53:59.496611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.508212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c9c01-6cd7-47e5-aa63-c6df6fcd46e5 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.510980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d704929-c2bf-446c-8332-db889bfc1fca admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.518215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2a44-222e-4054-b85e-988a2f5fc19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.518895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2a44-222e-4054-b85e-988a2f5fc19d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.519950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2a44-222e-4054-b85e-988a2f5fc19d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.520079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2a44-222e-4054-b85e-988a2f5fc19d admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.520743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc2a44-222e-4054-b85e-988a2f5fc19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.521254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.522365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc2a44-222e-4054-b85e-988a2f5fc19d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.522830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.523637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.524205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] PATH_INFO: `/v3/projects/6825f42c5b1041fa9d2610da32ed6c36/users/50c3e58b68204eb5bc33d937ddb2663f/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.526907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6825f42c5b1041fa9d2610da32ed6c36, user_id=50c3e58b68204eb5bc33d937ddb2663f, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.531685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.548101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 943/1880] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:59 2022] PUT /identity/v3/projects/6825f42c5b1041fa9d2610da32ed6c36/users/50c3e58b68204eb5bc33d937ddb2663f/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:59.550249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 938/1881] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:53:59.552191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.557940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.558408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.559443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.614525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] MFA Rules not processed for user `50c3e58b68204eb5bc33d937ddb2663f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:59.616062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:59.706179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc154-d520-476b-9a09-6f9e2c812580 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:53:59.722519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee491c3-ab30-409d-ba84-0ea58225e58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:53:59.724252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee491c3-ab30-409d-ba84-0ea58225e58c admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.724723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee491c3-ab30-409d-ba84-0ea58225e58c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.725383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee491c3-ab30-409d-ba84-0ea58225e58c admin admin] PATH_INFO: `/v3/projects/30de3c2cd2ad40f3a8020238549d6270/users/2305794173b14059ae600f5d9bb270a1/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.757778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee491c3-ab30-409d-ba84-0ea58225e58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30de3c2cd2ad40f3a8020238549d6270, user_id=2305794173b14059ae600f5d9bb270a1, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:53:59.764936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee491c3-ab30-409d-ba84-0ea58225e58c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:53:59.781014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 939/1882] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:53:59.795566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:53:59.799874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:59.805480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 944/1883] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:53:59 2022] PUT /identity/v3/projects/30de3c2cd2ad40f3a8020238549d6270/users/2305794173b14059ae600f5d9bb270a1/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:53:59.818801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:53:59.819311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:53:59.820642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:53:59.902872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] MFA Rules not processed for user `2305794173b14059ae600f5d9bb270a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:53:59.917114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:53:59.972095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80011acd-ae9e-43f6-b22b-97fae8952f24 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:00.017371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 945/1884] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:53:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:00.022758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:00.023416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:00.023694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:00.023966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:00.028864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:00.030827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:00.042448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61554a-e24d-4097-b0e2-1f81926242ae None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:00.046214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:00.046934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:00.047276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:00.047612 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:00.058858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:00.060640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:00.073969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 946/1885] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:00.092702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:00.094188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:00.094322 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:00.103863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 940/1886] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:53:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:00.156749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33c49a-5832-4011-adae-51e722669226 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:00.162876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:00.163759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:00.164081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:00.164355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] PATH_INFO: `/v3/users/2305794173b14059ae600f5d9bb270a1` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:00.165742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2305794173b14059ae600f5d9bb270a1)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:00.167911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:00.197606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:00.223568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ee0c-5eb0-40a4-ad72-b133834eb89c service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:00.232678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:00.233718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:00.234002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:00.234419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:00.236854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:00.256115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2305794173b14059ae600f5d9bb270a1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:00.271162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2305794173b14059ae600f5d9bb270a1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:00.282312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2305794173b14059ae600f5d9bb270a1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:00.293626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2305794173b14059ae600f5d9bb270a1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:00.294516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b0a9945c-5bf8-4861-aab0-9ae2f4acb197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2305794173b14059ae600f5d9bb270a1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:00.303108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 947/1887] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:00 2022] DELETE /identity/v3/users/2305794173b14059ae600f5d9bb270a1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:00.307385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:00.307853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:00.308312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:00.318450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:00.319886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:00.328000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:00.329211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:00.330552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 941/1888] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:00.414522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 948/1889] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:00.445232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:00.448018 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:00.532522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db61b-7f97-4ca4-bf9c-d414c471b07c service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:00.584599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da30aa-2dad-4bdc-bba1-1a1d36e51875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:00.585260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da30aa-2dad-4bdc-bba1-1a1d36e51875 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:00.585530 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da30aa-2dad-4bdc-bba1-1a1d36e51875 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:00.585800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da30aa-2dad-4bdc-bba1-1a1d36e51875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:00.599897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da30aa-2dad-4bdc-bba1-1a1d36e51875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:00.601587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da30aa-2dad-4bdc-bba1-1a1d36e51875 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:00.613049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 942/1890] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:01.212958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.214469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:01.226109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cecdc-0ec9-4292-82af-49fa9eb547fb None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.230776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.231638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.231917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.232258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] PATH_INFO: `/v3/projects/30de3c2cd2ad40f3a8020238549d6270` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.233581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30de3c2cd2ad40f3a8020238549d6270)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.235756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.284707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30de3c2cd2ad40f3a8020238549d6270', 'request_id': 'req-26eb9284-dd0f-4520-86b7-53195709516f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:01.294036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30de3c2cd2ad40f3a8020238549d6270', 'request_id': 'req-26eb9284-dd0f-4520-86b7-53195709516f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:01.299688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30de3c2cd2ad40f3a8020238549d6270', 'request_id': 'req-26eb9284-dd0f-4520-86b7-53195709516f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:01.315760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] The token cache is being invalidate because project 30de3c2cd2ad40f3a8020238549d6270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:01.316140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:01.316858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26eb9284-dd0f-4520-86b7-53195709516f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:01.318521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 949/1891] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:01 2022] DELETE /identity/v3/projects/30de3c2cd2ad40f3a8020238549d6270 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:01.323600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c1e3-fbaf-4508-8f6e-294b1979ddb7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.323905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c1e3-fbaf-4508-8f6e-294b1979ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.324191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c1e3-fbaf-4508-8f6e-294b1979ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.342502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e923c1e3-fbaf-4508-8f6e-294b1979ddb7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:01.343890 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e923c1e3-fbaf-4508-8f6e-294b1979ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:01.412431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 943/1892] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:01.420507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424dcc-9898-44d5-bb90-ff9913ec77ee None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.420897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424dcc-9898-44d5-bb90-ff9913ec77ee None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.421175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424dcc-9898-44d5-bb90-ff9913ec77ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.441602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ee424dcc-9898-44d5-bb90-ff9913ec77ee None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:01.442892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ee424dcc-9898-44d5-bb90-ff9913ec77ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:01.452399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 950/1893] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:01.456939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c1e3-fbaf-4508-8f6e-294b1979ddb7 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.467325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c1e3-fbaf-4508-8f6e-294b1979ddb7 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.472891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.473579 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.474583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.474583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.475049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:01.475428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.477173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.489710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 944/1894] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:54:01.495508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424dcc-9898-44d5-bb90-ff9913ec77ee None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.505088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424dcc-9898-44d5-bb90-ff9913ec77ee None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.510254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.510929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.511214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.511490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.512186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.514113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.540114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 951/1895] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:01 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:01.544488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.556499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d277b-0d8f-4927-b966-a7f98bcffb9f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.615099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.615777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.616063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.616340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.617044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.619017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.640383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 945/1896] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:01 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:01.644457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.655265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a105c24-60e7-4bbd-962c-8338e9c26f2c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.662608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.663288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.663575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.663849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.664580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.666225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.677044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 952/1897] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:01.681041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.691440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cc54f-0963-417b-b4eb-72c7a5b28d77 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.696347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387f43a-ad71-4e79-be7e-08632d4529a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.697009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f43a-ad71-4e79-be7e-08632d4529a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.697292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f43a-ad71-4e79-be7e-08632d4529a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.697623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f43a-ad71-4e79-be7e-08632d4529a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.698363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387f43a-ad71-4e79-be7e-08632d4529a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.699964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387f43a-ad71-4e79-be7e-08632d4529a0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.710128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 946/1898] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:01.714765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.725495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139bd4b-d586-4017-aa8d-affce807a882 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.730508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.731508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.732091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.732091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] PATH_INFO: `/v3/projects/b6883baafe1e4252963b94cdb54c406b/users/ddd8ee3b9d89419898a8def57cd3de87/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.747353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6883baafe1e4252963b94cdb54c406b, user_id=ddd8ee3b9d89419898a8def57cd3de87, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.750332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.766285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 953/1899] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:01 2022] PUT /identity/v3/projects/b6883baafe1e4252963b94cdb54c406b/users/ddd8ee3b9d89419898a8def57cd3de87/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:01.776626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.776952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.777233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.805010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] MFA Rules not processed for user `ddd8ee3b9d89419898a8def57cd3de87`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:01.806229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:01.867816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 947/1900] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:01.879341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:01.881149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:01.935213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244a143-5a0f-4f9d-9fbf-9cd9db15a585 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:01.939080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa1e11-06db-4db2-afcd-c4156ab72683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:01.939741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1e11-06db-4db2-afcd-c4156ab72683 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:01.940020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1e11-06db-4db2-afcd-c4156ab72683 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:01.940324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1e11-06db-4db2-afcd-c4156ab72683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:01.952596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa1e11-06db-4db2-afcd-c4156ab72683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:01.952596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa1e11-06db-4db2-afcd-c4156ab72683 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:01.963182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 954/1901] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:02.568999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:02.570523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:02.632075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76467c51-8a8c-44bf-a4f1-3e68f85ecd1d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:02.636505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:02.637485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:02.637683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:02.637948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] PATH_INFO: `/v3/users/ded54ed4c416449287d85b2d9010a553` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:02.639169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded54ed4c416449287d85b2d9010a553)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:02.641108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:02.691376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded54ed4c416449287d85b2d9010a553'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:02.698222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded54ed4c416449287d85b2d9010a553'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:02.698967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded54ed4c416449287d85b2d9010a553'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:02.699567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded54ed4c416449287d85b2d9010a553'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:02.712805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded54ed4c416449287d85b2d9010a553'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:02.727588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 948/1902] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:02 2022] DELETE /identity/v3/users/ded54ed4c416449287d85b2d9010a553 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:02.733957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:02.734462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:02.735179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:02.754614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:02.756038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:02.815915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 955/1903] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:02.825610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:02.827194 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:02.888101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3d0aa-4677-4405-b06e-7be065d6940c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:02.892280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:02.892953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:02.893248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:02.893606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:02.903094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:02.904670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:02.914291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 949/1904] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:03.333502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:03.335644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:03.369937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65593f-3e9b-4d22-8ea4-f5818ab726d4 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:03.377311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:03.378503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:03.378794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:03.379040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] PATH_INFO: `/v3/projects/70bbe56d901947879ad7ff4942d180c8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:03.380988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bbe56d901947879ad7ff4942d180c8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:03.383279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:03.464493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bbe56d901947879ad7ff4942d180c8', 'request_id': 'req-72f415e7-3154-4d28-b209-41e50d6c15f7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.474660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bbe56d901947879ad7ff4942d180c8', 'request_id': 'req-72f415e7-3154-4d28-b209-41e50d6c15f7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.485727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bbe56d901947879ad7ff4942d180c8', 'request_id': 'req-72f415e7-3154-4d28-b209-41e50d6c15f7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.508181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] The token cache is being invalidate because project 70bbe56d901947879ad7ff4942d180c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:03.508527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.513529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.518347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 956/1905] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:03 2022] DELETE /identity/v3/projects/70bbe56d901947879ad7ff4942d180c8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:03.522666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:03.533798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f14aa-ec6f-4b43-a7ea-29e904b56c86 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:03.621616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:03.623350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:03.623665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:03.624354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] PATH_INFO: `/v3/users/9e3b79bf651c48b59a9a013c7cd0f6a3` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:03.625730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3b79bf651c48b59a9a013c7cd0f6a3)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:03.631957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:03.730126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3b79bf651c48b59a9a013c7cd0f6a3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.750842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3b79bf651c48b59a9a013c7cd0f6a3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.751985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3b79bf651c48b59a9a013c7cd0f6a3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.752685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3b79bf651c48b59a9a013c7cd0f6a3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.767029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c6eaa5b7-5421-49fd-abba-7f441b1bde86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3b79bf651c48b59a9a013c7cd0f6a3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:03.786981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 950/1906] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:03 2022] DELETE /identity/v3/users/9e3b79bf651c48b59a9a013c7cd0f6a3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:04.111643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.113356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:04.126936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f415e7-3154-4d28-b209-41e50d6c15f7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.193440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.194577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.195099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.195179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] PATH_INFO: `/v3/projects/2a046b33ee3749cab350c01662147c9f` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.196345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a046b33ee3749cab350c01662147c9f)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.198289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.246230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a046b33ee3749cab350c01662147c9f', 'request_id': 'req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:04.254617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a046b33ee3749cab350c01662147c9f', 'request_id': 'req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:04.261281 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a046b33ee3749cab350c01662147c9f', 'request_id': 'req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:04.272942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] The token cache is being invalidate because project 2a046b33ee3749cab350c01662147c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:04.273305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:04.274011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4b6e1d21-42a5-4e8d-a0c6-bb0170f5bce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:04.275756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 957/1907] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:04 2022] DELETE /identity/v3/projects/2a046b33ee3749cab350c01662147c9f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:04.280818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1192-7fa3-4877-954b-7014a9d6665e None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.281106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1192-7fa3-4877-954b-7014a9d6665e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.281388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1192-7fa3-4877-954b-7014a9d6665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.298888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-03ac1192-7fa3-4877-954b-7014a9d6665e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:04.300079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-03ac1192-7fa3-4877-954b-7014a9d6665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:04.358415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 951/1908] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:04.366743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac82a8e-c9cc-4843-b885-08e1f1f225e7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.367031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac82a8e-c9cc-4843-b885-08e1f1f225e7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.367306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac82a8e-c9cc-4843-b885-08e1f1f225e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.387749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5ac82a8e-c9cc-4843-b885-08e1f1f225e7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:04.388939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5ac82a8e-c9cc-4843-b885-08e1f1f225e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:04.398476 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 958/1909] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:04.404020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1192-7fa3-4877-954b-7014a9d6665e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.414113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1192-7fa3-4877-954b-7014a9d6665e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.419989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.420661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.420982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.421257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.421980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:04.422312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.423893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.435950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 952/1910] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:04.440331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac82a8e-c9cc-4843-b885-08e1f1f225e7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.449908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac82a8e-c9cc-4843-b885-08e1f1f225e7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.455853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.456507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.456788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.457063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.457742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.459667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.488430 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 959/1911] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:04 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:04.492653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.502738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94290b-4e40-43b2-906c-60c2f18282f3 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.561046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.561872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.562257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.562583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.563372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.565342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.588994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 953/1912] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:04 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:04.590326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.601216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98720f0-8a00-4810-9668-6d4fe5f48f0a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.606376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.607046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.607312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.607584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.608355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.610314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.620933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 960/1913] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:04.624956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.635271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685d0f0-e9c9-46ed-b269-f33b8cb37126 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.649528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dea48-e91d-4a8b-b6cb-a416e4f8e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.650258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dea48-e91d-4a8b-b6cb-a416e4f8e391 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.650547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dea48-e91d-4a8b-b6cb-a416e4f8e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.650827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dea48-e91d-4a8b-b6cb-a416e4f8e391 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.651570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dea48-e91d-4a8b-b6cb-a416e4f8e391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.653230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dea48-e91d-4a8b-b6cb-a416e4f8e391 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.663682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 954/1914] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:04.667793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.678236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed745f-2707-4b07-9fbc-721a205edb3e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.682923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.683925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.684210 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.684482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] PATH_INFO: `/v3/projects/439ec76b46bd483fa481056955e9e6e2/users/feb11ff3ee214d85a46f4e34124845c3/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.699113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=439ec76b46bd483fa481056955e9e6e2, user_id=feb11ff3ee214d85a46f4e34124845c3, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.701719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.716008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 961/1915] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:04 2022] PUT /identity/v3/projects/439ec76b46bd483fa481056955e9e6e2/users/feb11ff3ee214d85a46f4e34124845c3/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:04.726566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662139c4-b1c8-4d35-a428-bc507f8a884b None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.726859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662139c4-b1c8-4d35-a428-bc507f8a884b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.727139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662139c4-b1c8-4d35-a428-bc507f8a884b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.753934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-662139c4-b1c8-4d35-a428-bc507f8a884b None None] MFA Rules not processed for user `feb11ff3ee214d85a46f4e34124845c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:04.755153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-662139c4-b1c8-4d35-a428-bc507f8a884b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:04.824505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 955/1916] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:04.829051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.893584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7b5f-355e-4496-ac18-8ebf75bed94f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:04.900731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:04.901752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:04.902235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:04.902516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:04.903350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:04.905501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:04.932904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 962/1917] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:04 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:04.937127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662139c4-b1c8-4d35-a428-bc507f8a884b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:04.947636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662139c4-b1c8-4d35-a428-bc507f8a884b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:05.002036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:05.002805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.003084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.003355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.004052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:05.005940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:05.030800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 956/1918] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:04 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:05.031992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:05.042841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cdf00-7f89-4d79-8f2a-ab447e1a791b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:05.048322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:05.048998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.049283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.049563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.050334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:05.051943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:05.063174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 963/1919] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:05.067821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:05.081184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222a381-b543-40a1-81c8-833b44bb8a0a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:05.086186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:05.087075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.087360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.087637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] PATH_INFO: `/v3/projects/4c1dc70fbee14853bf94dd9be53766e3/users/b594cf52b571457e92c03a153fd089f3/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.103557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1dc70fbee14853bf94dd9be53766e3, user_id=b594cf52b571457e92c03a153fd089f3, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:05.106262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:05.120963 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 957/1920] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:05 2022] PUT /identity/v3/projects/4c1dc70fbee14853bf94dd9be53766e3/users/b594cf52b571457e92c03a153fd089f3/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:05.125054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:05.135900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952a158-aa4b-4abb-bf4d-1f9c243126af admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:05.193114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb088bec-5eed-4cbe-a9f3-1895f91b86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:05.193779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb088bec-5eed-4cbe-a9f3-1895f91b86f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.194032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb088bec-5eed-4cbe-a9f3-1895f91b86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.194348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb088bec-5eed-4cbe-a9f3-1895f91b86f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.195036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb088bec-5eed-4cbe-a9f3-1895f91b86f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:05.196645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb088bec-5eed-4cbe-a9f3-1895f91b86f4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:05.207138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 964/1921] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:05.211269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:05.221889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e5995-3470-4dd6-83d1-8079c4bb7fce admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:05.226753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:05.227531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.227812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.228072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] PATH_INFO: `/v3/projects/4c1dc70fbee14853bf94dd9be53766e3/users/b594cf52b571457e92c03a153fd089f3/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.230037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1dc70fbee14853bf94dd9be53766e3, user_id=b594cf52b571457e92c03a153fd089f3, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:05.232706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:05.243732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 958/1922] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:05 2022] PUT /identity/v3/projects/4c1dc70fbee14853bf94dd9be53766e3/users/b594cf52b571457e92c03a153fd089f3/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:05.253623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26463d6f-ae1d-417f-8d73-bc6b0d2cf916 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.253912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26463d6f-ae1d-417f-8d73-bc6b0d2cf916 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.254220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26463d6f-ae1d-417f-8d73-bc6b0d2cf916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.280597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-26463d6f-ae1d-417f-8d73-bc6b0d2cf916 None None] MFA Rules not processed for user `b594cf52b571457e92c03a153fd089f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:05.281824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-26463d6f-ae1d-417f-8d73-bc6b0d2cf916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:05.350663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 965/1923] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:05.362567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:05.364524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:05.425452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210ca3f-460c-4b50-b6da-e9de6ca3c331 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:05.429933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:05.430612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.430867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.431141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.441017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:05.442475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:05.455629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 959/1924] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:05.539703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26463d6f-ae1d-417f-8d73-bc6b0d2cf916 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:05.549200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26463d6f-ae1d-417f-8d73-bc6b0d2cf916 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:05.552813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd64091-c6fd-4ee6-a848-2d45090a39c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:05.553478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64091-c6fd-4ee6-a848-2d45090a39c8 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:05.553758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64091-c6fd-4ee6-a848-2d45090a39c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:05.554026 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64091-c6fd-4ee6-a848-2d45090a39c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:05.612435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd64091-c6fd-4ee6-a848-2d45090a39c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:05.613937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd64091-c6fd-4ee6-a848-2d45090a39c8 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:05.623313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 966/1925] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:08.635092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:08.636566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:08.701044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1014b-ba3c-4d38-bfe0-f13fecb771ca service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:08.706334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:08.707208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:08.707475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:08.707752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] PATH_INFO: `/v3/users/0ef59d7cf6354a768ae0ec0d02d7a0ed` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:08.708971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef59d7cf6354a768ae0ec0d02d7a0ed)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:08.710903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:08.759937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef59d7cf6354a768ae0ec0d02d7a0ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:08.767233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef59d7cf6354a768ae0ec0d02d7a0ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:08.767911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef59d7cf6354a768ae0ec0d02d7a0ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:08.768526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef59d7cf6354a768ae0ec0d02d7a0ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:08.780119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef59d7cf6354a768ae0ec0d02d7a0ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:08.793447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 960/1926] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:08 2022] DELETE /identity/v3/users/0ef59d7cf6354a768ae0ec0d02d7a0ed => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:08.797908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:08.798433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:08.798608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:08.816134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:08.817708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:08.878638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 967/1927] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:08.888452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:08.891340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:08.949079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6e4bc-0220-42b4-8ece-c2e8e96dc7e1 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:08.952864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:08.953524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:08.953796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:08.954108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:08.966262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:08.967846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:08.978714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 961/1928] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:09.259753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:09.261347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:09.273994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba357fe1-ae61-4944-919b-8195ced42617 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:09.279071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:09.279837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:09.280231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:09.280569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] PATH_INFO: `/v3/projects/892e45a4f8b44b5395273732d6371050` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:09.281866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=892e45a4f8b44b5395273732d6371050)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:09.283925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:09.337166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892e45a4f8b44b5395273732d6371050', 'request_id': 'req-63647f25-3b73-4d23-8121-75fe86042aa9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.349614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892e45a4f8b44b5395273732d6371050', 'request_id': 'req-63647f25-3b73-4d23-8121-75fe86042aa9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.355419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892e45a4f8b44b5395273732d6371050', 'request_id': 'req-63647f25-3b73-4d23-8121-75fe86042aa9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.367099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] The token cache is being invalidate because project 892e45a4f8b44b5395273732d6371050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:09.367394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.368633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.370532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 968/1929] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:09 2022] DELETE /identity/v3/projects/892e45a4f8b44b5395273732d6371050 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:09.374342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:09.383985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f42e5-743b-45d1-86b7-97d77df8825d service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:09.444984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:09.445913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:09.446260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:09.446542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] PATH_INFO: `/v3/users/50c3e58b68204eb5bc33d937ddb2663f` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:09.447759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c3e58b68204eb5bc33d937ddb2663f)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:09.449655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:09.507162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c3e58b68204eb5bc33d937ddb2663f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.516417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c3e58b68204eb5bc33d937ddb2663f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.517202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c3e58b68204eb5bc33d937ddb2663f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.517912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c3e58b68204eb5bc33d937ddb2663f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.533140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-64a85015-bbaa-4342-a310-e8266bbca1ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c3e58b68204eb5bc33d937ddb2663f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:09.562369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 962/1930] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:09 2022] DELETE /identity/v3/users/50c3e58b68204eb5bc33d937ddb2663f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:09.880388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:09.882108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:09.897975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63647f25-3b73-4d23-8121-75fe86042aa9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:09.975984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:09.976976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:09.977327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:09.977676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] PATH_INFO: `/v3/projects/6825f42c5b1041fa9d2610da32ed6c36` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:09.979504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6825f42c5b1041fa9d2610da32ed6c36)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:09.981814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.044891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6825f42c5b1041fa9d2610da32ed6c36', 'request_id': 'req-92245133-9de2-44b2-91d4-20157d56957a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.053880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6825f42c5b1041fa9d2610da32ed6c36', 'request_id': 'req-92245133-9de2-44b2-91d4-20157d56957a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.059565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6825f42c5b1041fa9d2610da32ed6c36', 'request_id': 'req-92245133-9de2-44b2-91d4-20157d56957a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.071532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] The token cache is being invalidate because project 6825f42c5b1041fa9d2610da32ed6c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:10.072193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.072934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92245133-9de2-44b2-91d4-20157d56957a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.074998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 969/1931] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:09 2022] DELETE /identity/v3/projects/6825f42c5b1041fa9d2610da32ed6c36 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:10.080490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729c325-9386-4d31-8d4f-9d06dd21ae98 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.080965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729c325-9386-4d31-8d4f-9d06dd21ae98 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.081211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729c325-9386-4d31-8d4f-9d06dd21ae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.098711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-1729c325-9386-4d31-8d4f-9d06dd21ae98 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:10.099975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1729c325-9386-4d31-8d4f-9d06dd21ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:10.166260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 963/1932] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:10.169111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0f9ce-13b7-4d52-8208-42ee92382cb2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.169598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0f9ce-13b7-4d52-8208-42ee92382cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.170057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0f9ce-13b7-4d52-8208-42ee92382cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.189960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-62f0f9ce-13b7-4d52-8208-42ee92382cb2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:10.191393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-62f0f9ce-13b7-4d52-8208-42ee92382cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:10.200301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 970/1933] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:10.204446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729c325-9386-4d31-8d4f-9d06dd21ae98 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.214492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729c325-9386-4d31-8d4f-9d06dd21ae98 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.219375 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.220034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.220314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.220570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.221454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:10.221953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.223588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.236104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 964/1934] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:10.240401 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0f9ce-13b7-4d52-8208-42ee92382cb2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.249757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0f9ce-13b7-4d52-8208-42ee92382cb2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.255125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.255790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.256071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.256379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.257077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.259027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.285726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 971/1935] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:10 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:10.290149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.300662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec41ba-8018-4109-b255-e8f6cbefaa0f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.380281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.380999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.381296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.381565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.382496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.384580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.410321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 965/1936] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:10 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:10.411449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.430123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7aa17-960b-4764-a1cd-be0d1d6a3a99 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.435377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.436173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.436535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.436874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.437610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.439239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.453029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 972/1937] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:10.454361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.465170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89831d7-b822-4f7f-b441-d8f086a24e49 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.472236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73aaaf-b6e6-4ab1-a1eb-2eb2422479a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.472544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73aaaf-b6e6-4ab1-a1eb-2eb2422479a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.472762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73aaaf-b6e6-4ab1-a1eb-2eb2422479a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.473030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73aaaf-b6e6-4ab1-a1eb-2eb2422479a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.474114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73aaaf-b6e6-4ab1-a1eb-2eb2422479a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.475363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73aaaf-b6e6-4ab1-a1eb-2eb2422479a4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.487456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 966/1938] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:10.491871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.507329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6f821-5da4-4272-be3b-6f2941b22755 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.513463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.514533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.514805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.515204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] PATH_INFO: `/v3/projects/3af1022f8e7a4f839ea55b7391a1fdd4/users/f8ab4addcb544a759679b9e8114d83e4/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.529789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af1022f8e7a4f839ea55b7391a1fdd4, user_id=f8ab4addcb544a759679b9e8114d83e4, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.532703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.545946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 973/1939] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:10 2022] PUT /identity/v3/projects/3af1022f8e7a4f839ea55b7391a1fdd4/users/f8ab4addcb544a759679b9e8114d83e4/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:10.557051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df583-69dc-42f6-8ddd-316723d2beb4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.557367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df583-69dc-42f6-8ddd-316723d2beb4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.557640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df583-69dc-42f6-8ddd-316723d2beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.586237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d42df583-69dc-42f6-8ddd-316723d2beb4 None None] MFA Rules not processed for user `f8ab4addcb544a759679b9e8114d83e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:10.587475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d42df583-69dc-42f6-8ddd-316723d2beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:10.662292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 967/1940] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:10.676697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.678833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:10.753429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57a2a-8ee7-4e36-b0f2-05100eba8dc2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.758524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19325c0a-35b1-496a-9dc6-8977a9c22ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.759188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19325c0a-35b1-496a-9dc6-8977a9c22ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.759473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19325c0a-35b1-496a-9dc6-8977a9c22ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.759749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19325c0a-35b1-496a-9dc6-8977a9c22ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.769115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19325c0a-35b1-496a-9dc6-8977a9c22ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.770715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19325c0a-35b1-496a-9dc6-8977a9c22ff6 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.780322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 974/1941] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:10.798616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42df583-69dc-42f6-8ddd-316723d2beb4 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:10.877341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42df583-69dc-42f6-8ddd-316723d2beb4 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:10.885239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:10.886702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:10.887046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:10.887420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] PATH_INFO: `/v3/users/f8ab4addcb544a759679b9e8114d83e4` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:10.889286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ab4addcb544a759679b9e8114d83e4)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:10.891934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:10.976188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ab4addcb544a759679b9e8114d83e4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.985226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ab4addcb544a759679b9e8114d83e4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.986199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ab4addcb544a759679b9e8114d83e4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:10.987097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ab4addcb544a759679b9e8114d83e4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:11.003754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ab4addcb544a759679b9e8114d83e4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:11.041585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 968/1942] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:10 2022] DELETE /identity/v3/users/f8ab4addcb544a759679b9e8114d83e4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:11.042921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:11.043378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:11.043489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:11.068772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:11.072104 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:11.160406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 975/1943] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:11.176400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:11.177953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:11.265842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877061-cca1-40af-a478-1537adb77f4c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:11.272652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95bf80-84f5-4b55-9a14-eca7e802a6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:11.273326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95bf80-84f5-4b55-9a14-eca7e802a6eb service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:11.273605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95bf80-84f5-4b55-9a14-eca7e802a6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:11.273879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95bf80-84f5-4b55-9a14-eca7e802a6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:11.286757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95bf80-84f5-4b55-9a14-eca7e802a6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:11.288763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95bf80-84f5-4b55-9a14-eca7e802a6eb service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:11.302677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 969/1944] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:11.992135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:11.993905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:12.011441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85029d-58c0-431d-b36b-dd92be867562 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.016824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.017701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.017976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.018437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] PATH_INFO: `/v3/projects/3af1022f8e7a4f839ea55b7391a1fdd4` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.021861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af1022f8e7a4f839ea55b7391a1fdd4)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.025816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.080389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af1022f8e7a4f839ea55b7391a1fdd4', 'request_id': 'req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:12.091703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af1022f8e7a4f839ea55b7391a1fdd4', 'request_id': 'req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:12.098558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af1022f8e7a4f839ea55b7391a1fdd4', 'request_id': 'req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:12.113310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] The token cache is being invalidate because project 3af1022f8e7a4f839ea55b7391a1fdd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:12.113591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:12.114527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20d47f74-4d38-4ea1-879b-d6e71d2d6fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:12.117736 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 976/1945] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:11 2022] DELETE /identity/v3/projects/3af1022f8e7a4f839ea55b7391a1fdd4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:12.122323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794bdc-200b-47b6-8edd-0e337f4227c6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.122819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794bdc-200b-47b6-8edd-0e337f4227c6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.123104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794bdc-200b-47b6-8edd-0e337f4227c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.141234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a3794bdc-200b-47b6-8edd-0e337f4227c6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:12.142554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a3794bdc-200b-47b6-8edd-0e337f4227c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:12.225393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 970/1946] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:12.231756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a8aa4-44d0-4868-8407-9c38aeaf03d7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.232113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a8aa4-44d0-4868-8407-9c38aeaf03d7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.232389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a8aa4-44d0-4868-8407-9c38aeaf03d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.251828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-677a8aa4-44d0-4868-8407-9c38aeaf03d7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:12.253128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-677a8aa4-44d0-4868-8407-9c38aeaf03d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:12.267532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 977/1947] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:12.268797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794bdc-200b-47b6-8edd-0e337f4227c6 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.282353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794bdc-200b-47b6-8edd-0e337f4227c6 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.292724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.292724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.292724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.292724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.293187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:12.293187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.295060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.318118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 971/1948] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:12.319979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a8aa4-44d0-4868-8407-9c38aeaf03d7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.337039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a8aa4-44d0-4868-8407-9c38aeaf03d7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.342888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.343533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.343819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.344096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.344803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.346799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.383283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.390784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 978/1949] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:12 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:12.395264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d99b0-9a09-4dfe-b084-ec78e8affb97 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.459642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.460420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.460771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.461116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.461915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.464119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.485521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 972/1950] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:12 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:12.489533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.500246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620dd3c-b73a-4fd0-b618-1c1ee42eeef4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.512792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.513481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.513768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.514043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.514894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.516496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.530331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 979/1951] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:12.531556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.541515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772401c8-91d0-4beb-bdb0-45a9082d764f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.546424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80153b-2b24-422b-ae4d-1f62c7d6335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.547618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80153b-2b24-422b-ae4d-1f62c7d6335c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.547903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80153b-2b24-422b-ae4d-1f62c7d6335c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.548179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80153b-2b24-422b-ae4d-1f62c7d6335c admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.548909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80153b-2b24-422b-ae4d-1f62c7d6335c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.550517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80153b-2b24-422b-ae4d-1f62c7d6335c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.560358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 973/1952] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:12.564466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.574719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c85a-7656-41fc-b7dd-5b3c195365a4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.579515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.580721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.581000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.581270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] PATH_INFO: `/v3/projects/e1c12d2f80c148659c3968265c0a633e/users/cc9a519b685b4795bd2a56f955d20d95/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.595342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c12d2f80c148659c3968265c0a633e, user_id=cc9a519b685b4795bd2a56f955d20d95, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.598749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.618042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 980/1953] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:12 2022] PUT /identity/v3/projects/e1c12d2f80c148659c3968265c0a633e/users/cc9a519b685b4795bd2a56f955d20d95/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:12.628278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b587a1-2520-4732-b915-23b632682a57 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.628580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b587a1-2520-4732-b915-23b632682a57 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.628845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b587a1-2520-4732-b915-23b632682a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.655592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-68b587a1-2520-4732-b915-23b632682a57 None None] MFA Rules not processed for user `cc9a519b685b4795bd2a56f955d20d95`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:12.656820 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-68b587a1-2520-4732-b915-23b632682a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:12.721453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 974/1954] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:12.725919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.786902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8e45c-758a-4c0d-863c-379a139d4778 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.792609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.793292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.793570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.793991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.794752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.796616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.823179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 981/1955] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:12 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:12.827385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b587a1-2520-4732-b915-23b632682a57 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.838316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b587a1-2520-4732-b915-23b632682a57 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.901181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.901861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.902175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.902461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.903162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.905129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.927845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 975/1956] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:12 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:12.931620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.941830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019d688-7388-4879-a631-5c131ef40e0a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.946793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.947530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.948230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.948230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:12.948788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:12.950604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:12.962025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 982/1957] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:12.966356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:12.976348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d317238-e2e4-43a2-ac3b-5f53506fcdf8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:12.980855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:12.981760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:12.982041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:12.982347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] PATH_INFO: `/v3/projects/473c70b47dd04f798e93f7fe3941d79a/users/f84cba5b682a442c808ed705dce54b17/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:13.000427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473c70b47dd04f798e93f7fe3941d79a, user_id=f84cba5b682a442c808ed705dce54b17, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:13.004591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:13.020344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 976/1958] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:12 2022] PUT /identity/v3/projects/473c70b47dd04f798e93f7fe3941d79a/users/f84cba5b682a442c808ed705dce54b17/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:13.024396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:13.034535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44f0e5-6a94-4482-b92c-27559fa61f37 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:13.091018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6f351-b60f-42e1-90ac-8e2700439053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:13.091692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6f351-b60f-42e1-90ac-8e2700439053 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:13.091974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6f351-b60f-42e1-90ac-8e2700439053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:13.092458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6f351-b60f-42e1-90ac-8e2700439053 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:13.093188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6f351-b60f-42e1-90ac-8e2700439053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:13.094811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6f351-b60f-42e1-90ac-8e2700439053 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:13.104573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 983/1959] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:13.108772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:13.118841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2ca16-bad3-4723-9281-bb24bd2d6d00 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:13.123364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:13.124299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:13.124564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:13.124835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] PATH_INFO: `/v3/projects/473c70b47dd04f798e93f7fe3941d79a/users/f84cba5b682a442c808ed705dce54b17/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:13.126858 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473c70b47dd04f798e93f7fe3941d79a, user_id=f84cba5b682a442c808ed705dce54b17, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:13.129474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:13.140309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 977/1960] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:13 2022] PUT /identity/v3/projects/473c70b47dd04f798e93f7fe3941d79a/users/f84cba5b682a442c808ed705dce54b17/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:13.151336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df9c-31a5-404d-b329-1bdfc2b9f75f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:13.151629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df9c-31a5-404d-b329-1bdfc2b9f75f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:13.151907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df9c-31a5-404d-b329-1bdfc2b9f75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:13.178731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-48c3df9c-31a5-404d-b329-1bdfc2b9f75f None None] MFA Rules not processed for user `f84cba5b682a442c808ed705dce54b17`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:13.179916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-48c3df9c-31a5-404d-b329-1bdfc2b9f75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:13.250074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 984/1961] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:13.260829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:13.262742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:13.319449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803efa-a247-4d61-9cf1-65b11a658997 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:13.343250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fbb99-9516-4f7e-8009-480da8ac9ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:13.344525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fbb99-9516-4f7e-8009-480da8ac9ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:13.344821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fbb99-9516-4f7e-8009-480da8ac9ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:13.345130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fbb99-9516-4f7e-8009-480da8ac9ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:13.407520 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fbb99-9516-4f7e-8009-480da8ac9ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:13.409053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fbb99-9516-4f7e-8009-480da8ac9ed8 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:13.417863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 978/1962] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:18.110655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3df9c-31a5-404d-b329-1bdfc2b9f75f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:18.207541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3df9c-31a5-404d-b329-1bdfc2b9f75f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:18.213658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:18.215089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:18.215606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:18.216125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] PATH_INFO: `/v3/users/cc9a519b685b4795bd2a56f955d20d95` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:18.217751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9a519b685b4795bd2a56f955d20d95)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:18.220420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:18.306989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9a519b685b4795bd2a56f955d20d95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:18.339730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9a519b685b4795bd2a56f955d20d95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:18.349451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9a519b685b4795bd2a56f955d20d95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:18.360648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9a519b685b4795bd2a56f955d20d95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:18.361649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9a519b685b4795bd2a56f955d20d95'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:18.373077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 985/1963] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:18 2022] DELETE /identity/v3/users/cc9a519b685b4795bd2a56f955d20d95 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:18.375656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:18.376135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:18.376351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:18.401590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:18.403639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:18.491141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 979/1964] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:18.501604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:18.503752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:18.572923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd535d8c-12e1-4424-9b08-a7956238a474 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:18.577103 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:18.577775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:18.578556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:18.579133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:18.590984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:18.592909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:18.604244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 986/1965] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:19.257768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:19.259797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:19.279051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f9489-f1b4-45e4-9f06-e81e06432b6b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:19.285714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:19.287370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:19.287813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:19.288243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] PATH_INFO: `/v3/projects/e1c12d2f80c148659c3968265c0a633e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:19.289953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c12d2f80c148659c3968265c0a633e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:19.292950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:19.373778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c12d2f80c148659c3968265c0a633e', 'request_id': 'req-50f35ca8-6935-4e26-b4e8-9802d6f73644'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.385004 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c12d2f80c148659c3968265c0a633e', 'request_id': 'req-50f35ca8-6935-4e26-b4e8-9802d6f73644'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.392598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c12d2f80c148659c3968265c0a633e', 'request_id': 'req-50f35ca8-6935-4e26-b4e8-9802d6f73644'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.407048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] The token cache is being invalidate because project e1c12d2f80c148659c3968265c0a633e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:19.407633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.408545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.413699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 980/1966] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:19 2022] DELETE /identity/v3/projects/e1c12d2f80c148659c3968265c0a633e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:19.414597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:19.424730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701bbc4-b0cf-4718-a31a-fdf309e1b421 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:19.495054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:19.496545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:19.496977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:19.497255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] PATH_INFO: `/v3/users/f84cba5b682a442c808ed705dce54b17` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:19.498624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84cba5b682a442c808ed705dce54b17)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:19.501055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:19.563421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84cba5b682a442c808ed705dce54b17'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.575607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84cba5b682a442c808ed705dce54b17'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.583713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84cba5b682a442c808ed705dce54b17'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.593286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84cba5b682a442c808ed705dce54b17'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.594334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ab1b59b3-4586-446c-ad61-52a8b08b6e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84cba5b682a442c808ed705dce54b17'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:19.601358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 987/1967] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:19 2022] DELETE /identity/v3/users/f84cba5b682a442c808ed705dce54b17 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:19.875097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:19.876695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:19.896287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35ca8-6935-4e26-b4e8-9802d6f73644 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:19.957519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:19.958423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:19.958704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:19.958975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] PATH_INFO: `/v3/projects/473c70b47dd04f798e93f7fe3941d79a` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:19.960200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=473c70b47dd04f798e93f7fe3941d79a)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:19.962163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.013529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473c70b47dd04f798e93f7fe3941d79a', 'request_id': 'req-476fefdd-7938-48c4-91c8-a0b16e21ef7d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:20.022464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473c70b47dd04f798e93f7fe3941d79a', 'request_id': 'req-476fefdd-7938-48c4-91c8-a0b16e21ef7d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:20.028513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473c70b47dd04f798e93f7fe3941d79a', 'request_id': 'req-476fefdd-7938-48c4-91c8-a0b16e21ef7d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:20.039978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] The token cache is being invalidate because project 473c70b47dd04f798e93f7fe3941d79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:20.040268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:20.040947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-476fefdd-7938-48c4-91c8-a0b16e21ef7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:20.042571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 981/1968] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:19 2022] DELETE /identity/v3/projects/473c70b47dd04f798e93f7fe3941d79a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:20.048037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e500e-c576-4969-bd67-67ddb1da7068 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.048229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e500e-c576-4969-bd67-67ddb1da7068 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.048506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e500e-c576-4969-bd67-67ddb1da7068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.067727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-0a8e500e-c576-4969-bd67-67ddb1da7068 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:20.069183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0a8e500e-c576-4969-bd67-67ddb1da7068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:20.129959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 988/1969] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:20.137853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d208a-ad67-4f54-93c7-dbc5f611b643 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.138169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d208a-ad67-4f54-93c7-dbc5f611b643 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.138455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d208a-ad67-4f54-93c7-dbc5f611b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.156848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-659d208a-ad67-4f54-93c7-dbc5f611b643 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:20.158065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-659d208a-ad67-4f54-93c7-dbc5f611b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:20.165875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 982/1970] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:20.170394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e500e-c576-4969-bd67-67ddb1da7068 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:20.181738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e500e-c576-4969-bd67-67ddb1da7068 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:20.186641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:20.187415 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.187687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.187882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.188612 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:20.188917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:20.190555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.202993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 989/1971] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:54:20.207708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d208a-ad67-4f54-93c7-dbc5f611b643 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:20.216965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d208a-ad67-4f54-93c7-dbc5f611b643 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:20.222037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:20.222717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.222950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.223250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.223919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:20.225900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.255525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 983/1972] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:20 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:20.257126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:20.267916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456e145-2800-44b9-95d9-7e343c48be52 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:20.330966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:20.331727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.332081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.332449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.333225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:20.335306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.360347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 990/1973] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:20 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:20.364945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:20.375605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466fa7f-6f9b-4263-8b0a-b9d19371bcad admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:20.388115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:20.389452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.389791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.390111 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.390918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:20.392582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.418167 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 984/1974] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:20.420729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:20.431662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ffbe-0805-40ca-832b-777aa99b3dd0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:20.437515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd260dc-f330-4051-aa2e-a922a09ef446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:20.438231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd260dc-f330-4051-aa2e-a922a09ef446 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.438516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd260dc-f330-4051-aa2e-a922a09ef446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.438793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd260dc-f330-4051-aa2e-a922a09ef446 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.439529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd260dc-f330-4051-aa2e-a922a09ef446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:20.441149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd260dc-f330-4051-aa2e-a922a09ef446 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.452301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 991/1975] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:20.456923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:20.468585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8154f-2f4b-4777-9ab1-8723ef7fcbd3 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:20.482198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:20.482198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.482198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.482198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] PATH_INFO: `/v3/projects/dcf4fbcb56b84e6a96801d771f325883/users/2f02fe7241df4201a5ff0293cff2557c/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.496878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf4fbcb56b84e6a96801d771f325883, user_id=2f02fe7241df4201a5ff0293cff2557c, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:20.499912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.524253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 985/1976] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:20 2022] PUT /identity/v3/projects/dcf4fbcb56b84e6a96801d771f325883/users/2f02fe7241df4201a5ff0293cff2557c/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:20.529259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02633a-db4a-4428-a904-112bd75df8ab None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.529557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02633a-db4a-4428-a904-112bd75df8ab None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.530638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02633a-db4a-4428-a904-112bd75df8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.547225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-4b02633a-db4a-4428-a904-112bd75df8ab None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:20.548433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4b02633a-db4a-4428-a904-112bd75df8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:20.613347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 992/1977] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:20.623298 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:20.625390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:20.682550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2fdd9-29d2-4feb-80bf-6f21a1759cf7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:20.686469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:20.687112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:20.687390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:20.687664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:20.697069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:20.698531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:20.708531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 986/1978] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:21.319922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975bba-a4a7-4754-a9c2-e4faa4fed98c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:21.320197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975bba-a4a7-4754-a9c2-e4faa4fed98c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:21.320474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975bba-a4a7-4754-a9c2-e4faa4fed98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:21.349093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-27975bba-a4a7-4754-a9c2-e4faa4fed98c None None] MFA Rules not processed for user `2f02fe7241df4201a5ff0293cff2557c`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:21.350274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-27975bba-a4a7-4754-a9c2-e4faa4fed98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:21.436965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 993/1979] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:21.449921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:21.451649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:21.507970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd651cc-d415-4eb6-8b3f-e2eead7dd312 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:21.511742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:21.512581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:21.512869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:21.513147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:21.522061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:21.523517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:21.543041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 987/1980] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:22.976417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac3eb3-a3f1-4dc2-9a2c-b716f8317a3c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:22.976417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac3eb3-a3f1-4dc2-9a2c-b716f8317a3c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:22.976417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac3eb3-a3f1-4dc2-9a2c-b716f8317a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:22.997008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9fac3eb3-a3f1-4dc2-9a2c-b716f8317a3c None None] MFA Rules not processed for user `2f02fe7241df4201a5ff0293cff2557c`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:22.998405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9fac3eb3-a3f1-4dc2-9a2c-b716f8317a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:23.010610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 994/1981] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:23.834062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:23.835613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:23.850002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e936-af05-43ca-a304-afcd9d610f1b service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:23.854962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:23.855841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:23.856245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:23.856606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] PATH_INFO: `/v3/users/feb11ff3ee214d85a46f4e34124845c3` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:23.857961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb11ff3ee214d85a46f4e34124845c3)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:23.859929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:23.906958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb11ff3ee214d85a46f4e34124845c3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:23.914196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb11ff3ee214d85a46f4e34124845c3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:23.915082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb11ff3ee214d85a46f4e34124845c3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:23.916647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb11ff3ee214d85a46f4e34124845c3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:23.930996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb11ff3ee214d85a46f4e34124845c3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:23.948812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 988/1982] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:23 2022] DELETE /identity/v3/users/feb11ff3ee214d85a46f4e34124845c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:23.951703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:23.952258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:23.952887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:23.975791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:23.977372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:24.043669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 995/1983] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:24.054116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:24.055957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:24.114488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449bbf-1e62-43ff-a21f-2facac900277 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:24.118477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:24.119179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:24.119472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:24.119776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:24.131229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:24.132723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:24.151118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 989/1984] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:24.671306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:24.673346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:24.689017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12faf3d-1ed9-4c54-bdec-4ab9109073b7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:24.694663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:24.695735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:24.696061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:24.697158 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] PATH_INFO: `/v3/projects/439ec76b46bd483fa481056955e9e6e2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:24.698767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] RBAC: Authorizing `identity:delete_project(project_id=439ec76b46bd483fa481056955e9e6e2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:24.701596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:24.763440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439ec76b46bd483fa481056955e9e6e2', 'request_id': 'req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.771459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439ec76b46bd483fa481056955e9e6e2', 'request_id': 'req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.778303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439ec76b46bd483fa481056955e9e6e2', 'request_id': 'req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.789748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] The token cache is being invalidate because project 439ec76b46bd483fa481056955e9e6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:24.790039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.790722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.792278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 996/1985] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:24 2022] DELETE /identity/v3/projects/439ec76b46bd483fa481056955e9e6e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:24.796585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:24.806995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871d8d-4308-461e-b9f5-a3b3a39936b8 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:24.880306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:24.882852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:24.883310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:24.883747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] PATH_INFO: `/v3/users/b594cf52b571457e92c03a153fd089f3` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:24.885444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b594cf52b571457e92c03a153fd089f3)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:24.888086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:24.944133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b594cf52b571457e92c03a153fd089f3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.951011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b594cf52b571457e92c03a153fd089f3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.951870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b594cf52b571457e92c03a153fd089f3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.953105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b594cf52b571457e92c03a153fd089f3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.966334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-40a9a3ed-8c47-40a4-89e0-1564091ec9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b594cf52b571457e92c03a153fd089f3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:24.982072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 990/1986] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:24 2022] DELETE /identity/v3/users/b594cf52b571457e92c03a153fd089f3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:25.287676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:25.289702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:25.305838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a13d1-7ec7-4e43-8603-0b7e238d766f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:25.373834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:25.374823 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.375110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.375388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] PATH_INFO: `/v3/projects/4c1dc70fbee14853bf94dd9be53766e3` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.376747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1dc70fbee14853bf94dd9be53766e3)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:25.379434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:25.428358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1dc70fbee14853bf94dd9be53766e3', 'request_id': 'req-1a41d13a-8e21-4aa1-a266-c64305a6ef23'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:25.439508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1dc70fbee14853bf94dd9be53766e3', 'request_id': 'req-1a41d13a-8e21-4aa1-a266-c64305a6ef23'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:25.445421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1dc70fbee14853bf94dd9be53766e3', 'request_id': 'req-1a41d13a-8e21-4aa1-a266-c64305a6ef23'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:25.458109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] The token cache is being invalidate because project 4c1dc70fbee14853bf94dd9be53766e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:25.458412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:25.459069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1a41d13a-8e21-4aa1-a266-c64305a6ef23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:25.460953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 997/1987] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:25 2022] DELETE /identity/v3/projects/4c1dc70fbee14853bf94dd9be53766e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:25.465994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9c66-6677-4e05-8cab-e2e16c9e8cf9 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.466771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9c66-6677-4e05-8cab-e2e16c9e8cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.467273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9c66-6677-4e05-8cab-e2e16c9e8cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.498473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-300b9c66-6677-4e05-8cab-e2e16c9e8cf9 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:25.501517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-300b9c66-6677-4e05-8cab-e2e16c9e8cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:25.594278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 991/1988] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:25.596207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869effc4-e2d8-4420-8f59-d8aa4d82f482 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.596822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869effc4-e2d8-4420-8f59-d8aa4d82f482 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.597107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869effc4-e2d8-4420-8f59-d8aa4d82f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.616098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-869effc4-e2d8-4420-8f59-d8aa4d82f482 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:25.617317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-869effc4-e2d8-4420-8f59-d8aa4d82f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:25.626675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 998/1989] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:25.630980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9c66-6677-4e05-8cab-e2e16c9e8cf9 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:25.640845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9c66-6677-4e05-8cab-e2e16c9e8cf9 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:25.645383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:25.646037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.646355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.646625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.647353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:25.647656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:25.649262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:25.662618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 992/1990] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:25.666746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869effc4-e2d8-4420-8f59-d8aa4d82f482 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:25.676416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869effc4-e2d8-4420-8f59-d8aa4d82f482 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:25.681228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:25.682028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.682367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.682858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.683557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:25.685420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:25.713231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 999/1991] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:25 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:25.717805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:25.727663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525ecb5-979d-4274-b83a-b184d2e29c99 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:25.822651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:25.823226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.823451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.823738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.824475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:25.826874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:25.853091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 993/1992] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:25 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:25.854950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:25.870160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1c3ce-e50b-4bfe-bf81-7808907fe490 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:25.877205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:25.878154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.878723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.879316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.880413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:25.883174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:25.909548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1000/1993] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:25.914013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:25.928675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbda2c-2483-4aab-8a7f-91291687449a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:25.940752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea5c0-24e5-4f5a-9fa4-7a032c75d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:25.941281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea5c0-24e5-4f5a-9fa4-7a032c75d13c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.941607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea5c0-24e5-4f5a-9fa4-7a032c75d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.941888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea5c0-24e5-4f5a-9fa4-7a032c75d13c admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.942741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea5c0-24e5-4f5a-9fa4-7a032c75d13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:25.944412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea5c0-24e5-4f5a-9fa4-7a032c75d13c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:25.955446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 994/1994] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:25.959425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:25.969348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61949430-fddf-463a-9b13-29e01543c126 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:25.974510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:25.975399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:25.975684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:25.975959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] PATH_INFO: `/v3/projects/d102ac8f57ea4e3382b323425a23b066/users/872dbf6243bd40be93ece31b23971ec5/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:25.990814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d102ac8f57ea4e3382b323425a23b066, user_id=872dbf6243bd40be93ece31b23971ec5, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:25.993512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.007427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1001/1995] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:25 2022] PUT /identity/v3/projects/d102ac8f57ea4e3382b323425a23b066/users/872dbf6243bd40be93ece31b23971ec5/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:26.019788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c6e21-2104-412d-becd-7ee0ad3892c4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.020079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c6e21-2104-412d-becd-7ee0ad3892c4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.020350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c6e21-2104-412d-becd-7ee0ad3892c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.047669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6a3c6e21-2104-412d-becd-7ee0ad3892c4 None None] MFA Rules not processed for user `872dbf6243bd40be93ece31b23971ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:26.048875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6a3c6e21-2104-412d-becd-7ee0ad3892c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:26.116216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 995/1996] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:26.119679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.188211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e62c1e-8021-47d4-be5a-03d8a4ad3ca7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.192988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.193650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.193934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.194259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.194969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.196891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.224796 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1002/1997] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:26 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:26.228666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c6e21-2104-412d-becd-7ee0ad3892c4 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.240801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c6e21-2104-412d-becd-7ee0ad3892c4 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.303348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.304029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.304313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.304588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.305305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.307283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.327781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 996/1998] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:26 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:26.332137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.342379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63139-c9e6-4f51-a27d-eb7230ef679f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.347069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.347735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.348020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.348297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.349017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.350711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.360802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1003/1999] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:26.367042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.377100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb148a-be6e-4300-ad96-7f4aca56dc7c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.383053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.385237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.385824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.386923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] PATH_INFO: `/v3/projects/c9197bedf21a464d9135607dd92302b9/users/043dfc262ccf4d66ac98031aa2c58ff7/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.403055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9197bedf21a464d9135607dd92302b9, user_id=043dfc262ccf4d66ac98031aa2c58ff7, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.405893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.422105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 997/2000] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:26 2022] PUT /identity/v3/projects/c9197bedf21a464d9135607dd92302b9/users/043dfc262ccf4d66ac98031aa2c58ff7/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:26.423390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.433829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0398d-9b8f-4984-b829-ed9ee4d11809 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.490509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef10825-c44b-49f9-8575-98eb858453a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.491187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10825-c44b-49f9-8575-98eb858453a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.491470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10825-c44b-49f9-8575-98eb858453a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.491747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10825-c44b-49f9-8575-98eb858453a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.492473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef10825-c44b-49f9-8575-98eb858453a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.494069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef10825-c44b-49f9-8575-98eb858453a3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.515254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1004/2001] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:26.519583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.530694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70471a0-a0d9-4763-a200-75e397e057ec admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.535551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.537352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.537352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.537352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] PATH_INFO: `/v3/projects/c9197bedf21a464d9135607dd92302b9/users/043dfc262ccf4d66ac98031aa2c58ff7/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.539309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9197bedf21a464d9135607dd92302b9, user_id=043dfc262ccf4d66ac98031aa2c58ff7, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.542009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.562906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 998/2002] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:26 2022] PUT /identity/v3/projects/c9197bedf21a464d9135607dd92302b9/users/043dfc262ccf4d66ac98031aa2c58ff7/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:26.564229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.564517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.564956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.597422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] MFA Rules not processed for user `043dfc262ccf4d66ac98031aa2c58ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:26.598760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:26.699283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.701243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:26.713129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1005/2003] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:26.725371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.727006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:26.776521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c342-fa69-4ca9-a671-93f423bfde96 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.782824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.783789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.784140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.784488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] PATH_INFO: `/v3/users/ddd8ee3b9d89419898a8def57cd3de87` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.786262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd8ee3b9d89419898a8def57cd3de87)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.788290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.791853 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a819c-dfa2-4fa5-906b-a76f093a9a07 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:26.798728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf811-cfbf-4a31-af0a-2713edc61661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:26.799466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf811-cfbf-4a31-af0a-2713edc61661 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.802675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf811-cfbf-4a31-af0a-2713edc61661 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.802963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf811-cfbf-4a31-af0a-2713edc61661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.813787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf811-cfbf-4a31-af0a-2713edc61661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:26.815429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf811-cfbf-4a31-af0a-2713edc61661 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:26.827927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1006/2004] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:26.850451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd8ee3b9d89419898a8def57cd3de87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:26.858025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd8ee3b9d89419898a8def57cd3de87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:26.858770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd8ee3b9d89419898a8def57cd3de87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:26.859389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd8ee3b9d89419898a8def57cd3de87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:26.872164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd8ee3b9d89419898a8def57cd3de87'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:26.894386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 999/2005] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:26 2022] DELETE /identity/v3/users/ddd8ee3b9d89419898a8def57cd3de87 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:26.899462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:26.899828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:26.900148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:26.918459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:26.919662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:26.932171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:26.935370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.001715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1007/2006] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:27.011789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e502-3881-4fe2-a1db-c8e2b7aecee0 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:27.015824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:27.016484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.016769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.017052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.018881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.020757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:27.022215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.088653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b219772-679f-4abb-9c5d-24939903fa98 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:27.092696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:27.093466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.094176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.094176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.099254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:27.101518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:27.104381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:27.106436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:27.116438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1000/2007] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:27.116802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1008/2008] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:27.418893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:27.420698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.426836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:27.428840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.442341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd711fb-9f46-434b-9247-cacfb0dba2bd service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:27.443346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb08e7e-d7c7-40ee-b19c-921607de3617 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:27.448561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:27.449461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.449746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.449997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:27.450212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] PATH_INFO: `/v3/users/872dbf6243bd40be93ece31b23971ec5` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.451449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=872dbf6243bd40be93ece31b23971ec5)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:27.452150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.452577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.452995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] PATH_INFO: `/v3/users/19d82c3febb6432ea1740fd552dcc480` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.453431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:27.455788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d82c3febb6432ea1740fd552dcc480)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:27.458616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:27.520655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872dbf6243bd40be93ece31b23971ec5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.522921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d82c3febb6432ea1740fd552dcc480'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.531376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d82c3febb6432ea1740fd552dcc480'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.533327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d82c3febb6432ea1740fd552dcc480'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.534492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d82c3febb6432ea1740fd552dcc480'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.538198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872dbf6243bd40be93ece31b23971ec5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.545730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872dbf6243bd40be93ece31b23971ec5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.551236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-663cabe2-7d45-490b-be3a-8351c3fec268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d82c3febb6432ea1740fd552dcc480'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.558200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872dbf6243bd40be93ece31b23971ec5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.558984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872dbf6243bd40be93ece31b23971ec5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.565549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1001/2009] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:27 2022] DELETE /identity/v3/users/19d82c3febb6432ea1740fd552dcc480 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:27.570595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1009/2010] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:27 2022] DELETE /identity/v3/users/872dbf6243bd40be93ece31b23971ec5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:27.571856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.572209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.572495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.594616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:27.595826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.663505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:27.665277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.672959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1002/2011] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:27.683006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22125-5662-4531-a01f-7c449f060b4d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:27.687521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:27.688936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:27.689134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.689964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.690536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.690878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] PATH_INFO: `/v3/projects/b6883baafe1e4252963b94cdb54c406b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.692352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6883baafe1e4252963b94cdb54c406b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:27.694536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:27.751297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e601a02-0077-42f6-9668-24f847fc491f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:27.751927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6883baafe1e4252963b94cdb54c406b', 'request_id': 'req-411dd426-5048-4a92-b44a-e5a4e82fb4be'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.764030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6883baafe1e4252963b94cdb54c406b', 'request_id': 'req-411dd426-5048-4a92-b44a-e5a4e82fb4be'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.773610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6883baafe1e4252963b94cdb54c406b', 'request_id': 'req-411dd426-5048-4a92-b44a-e5a4e82fb4be'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.789036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] The token cache is being invalidate because project b6883baafe1e4252963b94cdb54c406b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:27.789491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.790105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.791965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1010/2012] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:27 2022] DELETE /identity/v3/projects/b6883baafe1e4252963b94cdb54c406b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:27.792739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:27.794022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.808742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e05e6-db9f-4854-b442-852704e86d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:27.809519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e05e6-db9f-4854-b442-852704e86d31 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.809925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e05e6-db9f-4854-b442-852704e86d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.810454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e05e6-db9f-4854-b442-852704e86d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.812534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-280e05e6-db9f-4854-b442-852704e86d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.860589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dd426-5048-4a92-b44a-e5a4e82fb4be admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:27.870636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:27.871521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.871797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.872068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] PATH_INFO: `/v3/projects/954b4133a08248a793e0416448286a00` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.873434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954b4133a08248a793e0416448286a00)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:27.874765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e05e6-db9f-4854-b442-852704e86d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:27.875381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:27.876236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e05e6-db9f-4854-b442-852704e86d31 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:27.885920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1003/2013] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:27.891475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19a781-4fac-4a75-96c9-8f844423e19d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.892187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19a781-4fac-4a75-96c9-8f844423e19d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.892458 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19a781-4fac-4a75-96c9-8f844423e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.915324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6a19a781-4fac-4a75-96c9-8f844423e19d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:27.916848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6a19a781-4fac-4a75-96c9-8f844423e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.928678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954b4133a08248a793e0416448286a00', 'request_id': 'req-d33d43eb-590f-4b24-8c92-2dbb35d633a8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.937487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954b4133a08248a793e0416448286a00', 'request_id': 'req-d33d43eb-590f-4b24-8c92-2dbb35d633a8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.943927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954b4133a08248a793e0416448286a00', 'request_id': 'req-d33d43eb-590f-4b24-8c92-2dbb35d633a8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.955896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] The token cache is being invalidate because project 954b4133a08248a793e0416448286a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:27.956241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.957022 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d33d43eb-590f-4b24-8c92-2dbb35d633a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:27.962047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1011/2014] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:27 2022] DELETE /identity/v3/projects/954b4133a08248a793e0416448286a00 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:27.963882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc95ec-6737-4f80-9180-fc4eedc9ec27 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.964240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc95ec-6737-4f80-9180-fc4eedc9ec27 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.964606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc95ec-6737-4f80-9180-fc4eedc9ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.984661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f0bc95ec-6737-4f80-9180-fc4eedc9ec27 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:27.984807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1004/2015] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:27.985992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f0bc95ec-6737-4f80-9180-fc4eedc9ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:27.993405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61a78-64e7-467d-a12c-fbf3a551b88b None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:27.993760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61a78-64e7-467d-a12c-fbf3a551b88b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:27.994146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61a78-64e7-467d-a12c-fbf3a551b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:27.994629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1012/2016] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:28.002424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d334-7d8e-4deb-bfdc-08916886a11b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.002728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d334-7d8e-4deb-bfdc-08916886a11b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.003445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d334-7d8e-4deb-bfdc-08916886a11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.018347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-86f61a78-64e7-467d-a12c-fbf3a551b88b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:28.020571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-86f61a78-64e7-467d-a12c-fbf3a551b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.025605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3030d334-7d8e-4deb-bfdc-08916886a11b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:28.026821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3030d334-7d8e-4deb-bfdc-08916886a11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.029273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1005/2017] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:28.033394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f61a78-64e7-467d-a12c-fbf3a551b88b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.035325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1013/2018] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:28.039380 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d334-7d8e-4deb-bfdc-08916886a11b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.043368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f61a78-64e7-467d-a12c-fbf3a551b88b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.048438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.048783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d334-7d8e-4deb-bfdc-08916886a11b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.049240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.049587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.049926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.050748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:28.051116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.052928 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.053934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.054349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.054630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.055016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.055769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:28.056068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.057672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.066985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1006/2019] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:28.074457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1014/2020] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:54:28.074635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.075857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.084592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f39f5-af03-4ca3-bfe5-ae8b09dc3481 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.087958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff69a4-bef8-4b95-8285-5dc76be35090 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.089317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.090076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.090395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.090671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.091424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.093775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.093905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.094424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.094765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.095436 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.095852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.097777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.124598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1015/2021] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:28.127460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.129515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1007/2022] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:28.130378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.196466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9b4a3-ec92-47f1-b89c-07ee7aa21fe1 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.201752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.202464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.202752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.203028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.203781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.205468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12e091-d06b-4e26-9408-9f26cad15113 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.206039 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.210325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.210996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.211280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.211556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.212282 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.214228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.230420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1008/2023] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:28.230420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.232082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.236328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1016/2024] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:28.236328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.243474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e8ffd-149d-4f0f-88d1-54803ee5ba00 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.244165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20717c-949a-4917-9e81-7cdd36cf641f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.247979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.248672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.248796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.248957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.249227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.249564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.249848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.250157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] PATH_INFO: `/v3/projects/d102ac8f57ea4e3382b323425a23b066` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.251404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.251560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d102ac8f57ea4e3382b323425a23b066)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.253008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.253445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.268414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1017/2025] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:28.268414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.278099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0797-0376-4385-a780-a4eedb060649 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.283636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.284386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.284733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.284991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.285673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.287428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.298126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1018/2026] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:28.298750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.306046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd102ac8f57ea4e3382b323425a23b066', 'request_id': 'req-5207720b-0cc3-4d51-a595-626cd7718813'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.308687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd032cbb-599b-495a-8c1b-3275c44d0d2a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.316641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd102ac8f57ea4e3382b323425a23b066', 'request_id': 'req-5207720b-0cc3-4d51-a595-626cd7718813'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.323178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd102ac8f57ea4e3382b323425a23b066', 'request_id': 'req-5207720b-0cc3-4d51-a595-626cd7718813'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.337048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] The token cache is being invalidate because project d102ac8f57ea4e3382b323425a23b066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:28.337505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.338293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.340173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1009/2027] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:28 2022] DELETE /identity/v3/projects/d102ac8f57ea4e3382b323425a23b066 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:28.341177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.344514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.368301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.369217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.369415 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.369660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.370463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.372206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.388238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1019/2028] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:28.388238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.388238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.400459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aea7fe-cf07-4464-8e39-3589731490b0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.406975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.408132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.408555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.408994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] PATH_INFO: `/v3/users/043dfc262ccf4d66ac98031aa2c58ff7` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.410406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043dfc262ccf4d66ac98031aa2c58ff7)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.412408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.415682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207720b-0cc3-4d51-a595-626cd7718813 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.420587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.430260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.430260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.430260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.430260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.430260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.437516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1010/2029] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:28.437516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.437516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.450387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9e9e1-1753-441e-9535-7505a87e6dac admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.455669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.456565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.456886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.457129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] PATH_INFO: `/v3/projects/1f6b7c6904ce4a34bf6aa5378f6e11a8/users/1da3efb779ab44cb96d8403dc93a17d7/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.477522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6b7c6904ce4a34bf6aa5378f6e11a8, user_id=1da3efb779ab44cb96d8403dc93a17d7, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.478020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043dfc262ccf4d66ac98031aa2c58ff7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.480248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.492562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043dfc262ccf4d66ac98031aa2c58ff7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.496884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1011/2030] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:28 2022] PUT /identity/v3/projects/1f6b7c6904ce4a34bf6aa5378f6e11a8/users/1da3efb779ab44cb96d8403dc93a17d7/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:28.497571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.501482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043dfc262ccf4d66ac98031aa2c58ff7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.514378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043dfc262ccf4d66ac98031aa2c58ff7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.515067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-08e56e8f-8e6c-460b-a174-33f31e355cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043dfc262ccf4d66ac98031aa2c58ff7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.521397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1020/2031] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:28 2022] DELETE /identity/v3/users/043dfc262ccf4d66ac98031aa2c58ff7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:28.522749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.523037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.523363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.553039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] MFA Rules not processed for user `1da3efb779ab44cb96d8403dc93a17d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:28.554386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.585058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbdf90-c667-46e7-826f-5f024e15628d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.630997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1021/2032] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:28.635958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.637563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.655979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e303c-a573-4465-b03c-e2c1e16393f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.656884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e303c-a573-4465-b03c-e2c1e16393f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.657161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e303c-a573-4465-b03c-e2c1e16393f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.657626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e303c-a573-4465-b03c-e2c1e16393f7 admin admin] PATH_INFO: `/v3/projects/82ccd22a0b914495b6ae39c481a66b4e/users/ebba6bc09c0c4ec8aae94e27bf4ab587/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.676838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e303c-a573-4465-b03c-e2c1e16393f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ccd22a0b914495b6ae39c481a66b4e, user_id=ebba6bc09c0c4ec8aae94e27bf4ab587, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.676946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e303c-a573-4465-b03c-e2c1e16393f7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.691606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1012/2033] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:28 2022] PUT /identity/v3/projects/82ccd22a0b914495b6ae39c481a66b4e/users/ebba6bc09c0c4ec8aae94e27bf4ab587/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:28.702379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a111ba0-db3d-45db-9f11-f6846121f779 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.702379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a111ba0-db3d-45db-9f11-f6846121f779 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.702549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a111ba0-db3d-45db-9f11-f6846121f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.720342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f1900-f2ae-4c02-9d66-159b2ecf3374 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.733659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3a111ba0-db3d-45db-9f11-f6846121f779 None None] MFA Rules not processed for user `ebba6bc09c0c4ec8aae94e27bf4ab587`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:28.734896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3a111ba0-db3d-45db-9f11-f6846121f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.778346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.779020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.779307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.779642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.780343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.782428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.801914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1013/2034] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:28.809466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1022/2035] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:28.813627 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a111ba0-db3d-45db-9f11-f6846121f779 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.813978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.815862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.825048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a111ba0-db3d-45db-9f11-f6846121f779 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.878363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dfb00-fe84-461b-a5f6-fcd7cdbbc53e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.881961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.882654 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.882941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.883221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.888675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.889376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.889662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.889936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.890670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.892580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.916034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1014/2036] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:28 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:28.916034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.916034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:28.929522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d645f-ac3d-431c-944a-29a22ffb72c7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.934893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.935945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.936372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.936657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] PATH_INFO: `/v3/projects/c9197bedf21a464d9135607dd92302b9` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.937957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9197bedf21a464d9135607dd92302b9)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.939983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.943332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.945178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.954340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1023/2037] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:28.955808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:28.968797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa016bf-c5ec-4588-9c20-22585f4b2136 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:28.974655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:28.975442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:28.976192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:28.976667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:28.978300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:28.980648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:28.995077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1024/2038] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:28.995797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9197bedf21a464d9135607dd92302b9', 'request_id': 'req-4dc9848d-ae29-4869-b683-1072170ae78f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:28.999645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.005675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9197bedf21a464d9135607dd92302b9', 'request_id': 'req-4dc9848d-ae29-4869-b683-1072170ae78f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:29.012428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9197bedf21a464d9135607dd92302b9', 'request_id': 'req-4dc9848d-ae29-4869-b683-1072170ae78f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:29.016037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc097a-9c19-47fc-8166-81b0ff42c13c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.027878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] The token cache is being invalidate because project c9197bedf21a464d9135607dd92302b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:29.028183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:29.028860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4dc9848d-ae29-4869-b683-1072170ae78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:29.030990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1015/2039] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:28 2022] DELETE /identity/v3/projects/c9197bedf21a464d9135607dd92302b9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:29.036112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67de9b8-8785-4417-8e44-4091ab5f31cf None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.036399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67de9b8-8785-4417-8e44-4091ab5f31cf None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.036675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67de9b8-8785-4417-8e44-4091ab5f31cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.067936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c67de9b8-8785-4417-8e44-4091ab5f31cf None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:29.069627 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c67de9b8-8785-4417-8e44-4091ab5f31cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:29.104777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.106280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.106624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.107254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] PATH_INFO: `/v3/projects/c6f5c02c09c542028ccfb3e2968f954b/users/dc40f9908ff4409ebb1cd3423f76029e/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.126252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f5c02c09c542028ccfb3e2968f954b, user_id=dc40f9908ff4409ebb1cd3423f76029e, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.129078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.145920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1025/2040] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:28 2022] PUT /identity/v3/projects/c6f5c02c09c542028ccfb3e2968f954b/users/dc40f9908ff4409ebb1cd3423f76029e/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:29.150194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.152539 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:29.160227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1016/2041] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:29.169185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aece2-7839-4767-a3e9-49381b162873 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.169737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aece2-7839-4767-a3e9-49381b162873 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.170283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aece2-7839-4767-a3e9-49381b162873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.190854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f69aece2-7839-4767-a3e9-49381b162873 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:29.192673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f69aece2-7839-4767-a3e9-49381b162873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:29.230572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec2a9-9e43-4585-a1f2-16bbcb354e4a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.236089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.236765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.237048 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.237325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.238056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.240241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.271475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1026/2042] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:29.275389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.281284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1017/2043] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:29.285838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aece2-7839-4767-a3e9-49381b162873 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.302242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aece2-7839-4767-a3e9-49381b162873 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.302242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.302242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.302242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.302574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.302574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:29.302788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.304742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.305302 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe653-6020-4131-8c62-b130ba8863e7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.314616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3c4b0-bcc9-44a3-9fbd-a7555e68f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.315647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3c4b0-bcc9-44a3-9fbd-a7555e68f80b admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.316014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3c4b0-bcc9-44a3-9fbd-a7555e68f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.316298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3c4b0-bcc9-44a3-9fbd-a7555e68f80b admin admin] PATH_INFO: `/v3/projects/c6f5c02c09c542028ccfb3e2968f954b/users/dc40f9908ff4409ebb1cd3423f76029e/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.318535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3c4b0-bcc9-44a3-9fbd-a7555e68f80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f5c02c09c542028ccfb3e2968f954b, user_id=dc40f9908ff4409ebb1cd3423f76029e, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.318656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1018/2044] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:29.321547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3c4b0-bcc9-44a3-9fbd-a7555e68f80b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.323133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.337644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b66f7-a720-49b6-8aac-e941417b476a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.341318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1027/2045] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:29 2022] PUT /identity/v3/projects/c6f5c02c09c542028ccfb3e2968f954b/users/dc40f9908ff4409ebb1cd3423f76029e/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:29.352505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.352966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.353167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.383489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] MFA Rules not processed for user `dc40f9908ff4409ebb1cd3423f76029e`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:29.384697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:29.405027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.405803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.406182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.406525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.407280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.409417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.436688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1019/2046] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:29.440743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.456652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1028/2047] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:29.468782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.470180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:29.517755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb140-870c-41c9-a620-f098f24ed7c9 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.523103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.523781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.524068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.524345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.525043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.527036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.530265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52397-ad40-4a2c-8be0-96dd35f14181 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.556227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1020/2048] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:29.560225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.572683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113cc1-1a43-446b-bc2d-cc0589bb1cac admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.578794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.579462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.580067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.580339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.582669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.584295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.596202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43824573-2398-42d9-8fa9-41a97f7a2798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.596933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43824573-2398-42d9-8fa9-41a97f7a2798 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.597398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43824573-2398-42d9-8fa9-41a97f7a2798 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.597732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43824573-2398-42d9-8fa9-41a97f7a2798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.598685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1021/2049] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:29.599688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.610580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f9f6-c95e-46f5-a3a8-7acbe9951b3c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.615267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.616062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.616348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.616624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.617667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.619022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.631566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1022/2050] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:29.635479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.646102 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf0e35-ee64-4e45-85ef-c5b95b47cc54 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.651386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.652268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.652693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.652994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] PATH_INFO: `/v3/projects/0cb01999621b4c67befd8af99c59b79f/users/0d858d4b7d7f498cbcdfe11bfb28ef81/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.667018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43824573-2398-42d9-8fa9-41a97f7a2798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.668429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43824573-2398-42d9-8fa9-41a97f7a2798 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.668968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb01999621b4c67befd8af99c59b79f, user_id=0d858d4b7d7f498cbcdfe11bfb28ef81, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.671968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.681549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1029/2051] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:29.686243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1023/2052] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:29 2022] PUT /identity/v3/projects/0cb01999621b4c67befd8af99c59b79f/users/0d858d4b7d7f498cbcdfe11bfb28ef81/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:29.696842 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9c53-4f77-4429-bdae-c777ca2a40ba None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.697131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9c53-4f77-4429-bdae-c777ca2a40ba None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.697418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad9c53-4f77-4429-bdae-c777ca2a40ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.728289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c6ad9c53-4f77-4429-bdae-c777ca2a40ba None None] MFA Rules not processed for user `0d858d4b7d7f498cbcdfe11bfb28ef81`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:29.729805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c6ad9c53-4f77-4429-bdae-c777ca2a40ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:29.762631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.824907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1030/2053] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:29.825773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06e4c-6669-487d-bb7b-d31536e78dab admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.829316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad9c53-4f77-4429-bdae-c777ca2a40ba None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.830482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.831215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.831584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.831898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.834065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:29.904295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.906226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.907924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad9c53-4f77-4429-bdae-c777ca2a40ba None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:29.913412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:29.914100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:29.914398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:29.914673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:29.915655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:29.915772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1024/2054] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:29.917393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:29.943205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1031/2055] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:29.947148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:29.958378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b94b9-4453-48cc-a714-2b48d85de6a8 service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:30.014844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:30.015608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:30.016131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:30.016435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:30.017445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:30.019750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:30.043734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1025/2056] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:29 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:30.047569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:30.057511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a268a-7c8f-412e-8330-6bec99342615 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:30.062095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:30.062758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:30.063040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:30.063310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:30.064031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:30.065647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:30.077051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1032/2057] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:30.081726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:30.091715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bdcca-85ba-42ae-9bb8-0b7f9907e6e2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:30.096372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:30.097239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:30.097517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:30.097788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] PATH_INFO: `/v3/projects/a53e8bc38e6f4032a2c71b6ebf3ea867/users/f8944f9e189c4a0eb7ab41d6f4268d67/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:30.111990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53e8bc38e6f4032a2c71b6ebf3ea867, user_id=f8944f9e189c4a0eb7ab41d6f4268d67, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:30.114714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:30.128134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1026/2058] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:30 2022] PUT /identity/v3/projects/a53e8bc38e6f4032a2c71b6ebf3ea867/users/f8944f9e189c4a0eb7ab41d6f4268d67/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:30.132412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:30.142816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e669-bf7d-48a7-9f21-8920f734e48f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:30.199591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c168d-078f-4c35-af37-6689f7412721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:30.200297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c168d-078f-4c35-af37-6689f7412721 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:30.200577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c168d-078f-4c35-af37-6689f7412721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:30.200851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c168d-078f-4c35-af37-6689f7412721 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:30.201578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c168d-078f-4c35-af37-6689f7412721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:30.203216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c168d-078f-4c35-af37-6689f7412721 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:30.216434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1033/2059] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:30.220574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:30.230971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52a15-c204-4e11-8267-c1684b37040a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:30.235666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:30.236555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:30.236838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:30.237117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] PATH_INFO: `/v3/projects/a53e8bc38e6f4032a2c71b6ebf3ea867/users/f8944f9e189c4a0eb7ab41d6f4268d67/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:30.239146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53e8bc38e6f4032a2c71b6ebf3ea867, user_id=f8944f9e189c4a0eb7ab41d6f4268d67, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:30.241771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:30.252655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1027/2060] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:30 2022] PUT /identity/v3/projects/a53e8bc38e6f4032a2c71b6ebf3ea867/users/f8944f9e189c4a0eb7ab41d6f4268d67/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:30.262903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:30.263265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:30.263663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:30.292097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] MFA Rules not processed for user `f8944f9e189c4a0eb7ab41d6f4268d67`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:30.293472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:30.377075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1034/2061] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:30.387743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:30.446139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cb006-e129-4176-860d-d5b4a0d95b9e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:30.449706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9693402-ede7-4741-a0db-34ffb2764f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:30.450385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9693402-ede7-4741-a0db-34ffb2764f1b service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:30.450684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9693402-ede7-4741-a0db-34ffb2764f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:30.450942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9693402-ede7-4741-a0db-34ffb2764f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:30.507870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9693402-ede7-4741-a0db-34ffb2764f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:30.509312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9693402-ede7-4741-a0db-34ffb2764f1b service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:30.518715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1028/2062] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:32.021983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:32.023696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:32.088599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903815a9-0024-44cf-b1e0-c74798eb9e28 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:32.093129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:32.094002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:32.094294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:32.094580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] PATH_INFO: `/v3/users/ebba6bc09c0c4ec8aae94e27bf4ab587` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:32.095767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebba6bc09c0c4ec8aae94e27bf4ab587)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:32.097662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:32.158199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebba6bc09c0c4ec8aae94e27bf4ab587'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.170943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebba6bc09c0c4ec8aae94e27bf4ab587'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.178340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebba6bc09c0c4ec8aae94e27bf4ab587'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.190279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebba6bc09c0c4ec8aae94e27bf4ab587'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.190811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebba6bc09c0c4ec8aae94e27bf4ab587'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.197542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1035/2063] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:32 2022] DELETE /identity/v3/users/ebba6bc09c0c4ec8aae94e27bf4ab587 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:32.202241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:32.202802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:32.202917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:32.231786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:32.233120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:32.295400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1029/2064] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:32.304968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:32.306406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:32.360640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e44d9-e83f-48f0-89fc-924e02ad2d72 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:32.364570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:32.365200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:32.365471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:32.365741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:32.374972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:32.376386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:32.385733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1036/2065] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:32.677770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:32.679574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:32.693592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a04fc2-52eb-46e0-92da-3e84fcb1fea1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:32.699408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:32.700358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:32.700549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:32.700823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] PATH_INFO: `/v3/projects/82ccd22a0b914495b6ae39c481a66b4e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:32.702273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ccd22a0b914495b6ae39c481a66b4e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:32.704182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:32.751552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ccd22a0b914495b6ae39c481a66b4e', 'request_id': 'req-7e3f8128-1bf8-426c-9892-e12444cf39cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.760091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ccd22a0b914495b6ae39c481a66b4e', 'request_id': 'req-7e3f8128-1bf8-426c-9892-e12444cf39cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.766097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ccd22a0b914495b6ae39c481a66b4e', 'request_id': 'req-7e3f8128-1bf8-426c-9892-e12444cf39cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.776999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] The token cache is being invalidate because project 82ccd22a0b914495b6ae39c481a66b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:32.777314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.778064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:32.779734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1030/2066] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:32 2022] DELETE /identity/v3/projects/82ccd22a0b914495b6ae39c481a66b4e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:36.834449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:36.834449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:36.890637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133524b-d6a1-41d6-8769-5f28ef5096ea service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:36.946981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32895c66-d679-4d5c-8d79-6153d986b4df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:36.948490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32895c66-d679-4d5c-8d79-6153d986b4df service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:36.949125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32895c66-d679-4d5c-8d79-6153d986b4df service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:36.949407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32895c66-d679-4d5c-8d79-6153d986b4df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:36.958523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-32895c66-d679-4d5c-8d79-6153d986b4df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:37.026956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32895c66-d679-4d5c-8d79-6153d986b4df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:37.026956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32895c66-d679-4d5c-8d79-6153d986b4df service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:37.035391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1037/2067] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:39.755198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:39.756635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:39.831190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f8128-1bf8-426c-9892-e12444cf39cb admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:39.836287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:39.837166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:39.837441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:39.837710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] PATH_INFO: `/v3/users/1da3efb779ab44cb96d8403dc93a17d7` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:39.838936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da3efb779ab44cb96d8403dc93a17d7)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:39.840895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:39.893814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da3efb779ab44cb96d8403dc93a17d7'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:39.900261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da3efb779ab44cb96d8403dc93a17d7'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:39.900914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da3efb779ab44cb96d8403dc93a17d7'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:39.901506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da3efb779ab44cb96d8403dc93a17d7'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:39.913239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da3efb779ab44cb96d8403dc93a17d7'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:39.929680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1031/2068] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:39 2022] DELETE /identity/v3/users/1da3efb779ab44cb96d8403dc93a17d7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:39.934356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:39.934873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:39.934961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:39.951950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:39.953149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:40.012191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1038/2069] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:40.023507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:40.024980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:40.083087 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf09473-b440-4bea-a0fe-f39453a1c5d2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:40.087151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:40.087788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:40.088067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:40.088361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:40.100855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:40.102311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:40.112051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1032/2070] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:40.403656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:40.405247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:40.418730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cc26a-4df2-4fb9-9939-7c12bebf08c7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:40.424250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:40.425999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:40.425999 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:40.426228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] PATH_INFO: `/v3/projects/1f6b7c6904ce4a34bf6aa5378f6e11a8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:40.427429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6b7c6904ce4a34bf6aa5378f6e11a8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:40.429359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:40.484191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6b7c6904ce4a34bf6aa5378f6e11a8', 'request_id': 'req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.492165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6b7c6904ce4a34bf6aa5378f6e11a8', 'request_id': 'req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.497747 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6b7c6904ce4a34bf6aa5378f6e11a8', 'request_id': 'req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.508458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] The token cache is being invalidate because project 1f6b7c6904ce4a34bf6aa5378f6e11a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:40.508738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.509352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.510922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1039/2071] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:40 2022] DELETE /identity/v3/projects/1f6b7c6904ce4a34bf6aa5378f6e11a8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:40.515034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:40.525269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924b22-0a22-48f0-aebb-db7c1cc1fd27 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:40.581764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:40.582678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:40.582964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:40.583238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] PATH_INFO: `/v3/users/dc40f9908ff4409ebb1cd3423f76029e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:40.584421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc40f9908ff4409ebb1cd3423f76029e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:40.586452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:40.633460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc40f9908ff4409ebb1cd3423f76029e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.640066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc40f9908ff4409ebb1cd3423f76029e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.640748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc40f9908ff4409ebb1cd3423f76029e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.641373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc40f9908ff4409ebb1cd3423f76029e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.652593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8d03485d-4fe3-483a-a55c-60ed32ecf08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc40f9908ff4409ebb1cd3423f76029e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:40.670434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1033/2072] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:40 2022] DELETE /identity/v3/users/dc40f9908ff4409ebb1cd3423f76029e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:40.960382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:40.961927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:40.976565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0a9e-2e15-4d55-a927-b5bc6fb7ae68 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.037495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.038419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.038697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.038977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] PATH_INFO: `/v3/projects/c6f5c02c09c542028ccfb3e2968f954b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.040285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f5c02c09c542028ccfb3e2968f954b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.042291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.093274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f5c02c09c542028ccfb3e2968f954b', 'request_id': 'req-9812ed27-c1b7-43d2-881f-dd02465651e4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:41.101908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f5c02c09c542028ccfb3e2968f954b', 'request_id': 'req-9812ed27-c1b7-43d2-881f-dd02465651e4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:41.108762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f5c02c09c542028ccfb3e2968f954b', 'request_id': 'req-9812ed27-c1b7-43d2-881f-dd02465651e4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:41.121518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] The token cache is being invalidate because project c6f5c02c09c542028ccfb3e2968f954b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:41.121815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:41.122581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9812ed27-c1b7-43d2-881f-dd02465651e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:41.124219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1040/2073] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:40 2022] DELETE /identity/v3/projects/c6f5c02c09c542028ccfb3e2968f954b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:41.129601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b980a-a7d4-4a20-99be-c994fe9dc6e3 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.130135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b980a-a7d4-4a20-99be-c994fe9dc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.130245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b980a-a7d4-4a20-99be-c994fe9dc6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.147825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-553b980a-a7d4-4a20-99be-c994fe9dc6e3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:41.148968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-553b980a-a7d4-4a20-99be-c994fe9dc6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:41.209177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1034/2074] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:41.217392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52141cf-7ed0-4250-b074-b1c1f524c6f2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.217711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52141cf-7ed0-4250-b074-b1c1f524c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.218000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52141cf-7ed0-4250-b074-b1c1f524c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.239170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e52141cf-7ed0-4250-b074-b1c1f524c6f2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:41.240374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e52141cf-7ed0-4250-b074-b1c1f524c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:41.248253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1041/2075] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:41.252759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b980a-a7d4-4a20-99be-c994fe9dc6e3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.263260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b980a-a7d4-4a20-99be-c994fe9dc6e3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.268436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.269095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.269394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.269670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.270438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:41.270747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.272349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.283771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1035/2076] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:41.288691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52141cf-7ed0-4250-b074-b1c1f524c6f2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.298772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52141cf-7ed0-4250-b074-b1c1f524c6f2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.305442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.306296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.306581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.306936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.307795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.310359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.337452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1042/2077] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:41 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:41.341715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.352025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac126a-c1cf-4233-8e9e-40988b66827c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.412423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.413076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.413362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.413649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.414408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.416430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.438829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1036/2078] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:41 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:41.443212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.453992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d8ef-1ed9-4776-bf60-8d7cce6eaf51 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.459428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.460082 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.460364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.460640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.461372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.463005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.473411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1043/2079] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:41.477349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.487378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d315a9-de6a-413b-bb7e-e964a4ab5899 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.492703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca4a75-6453-4255-abb8-31f4ed5b1a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.493376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4a75-6453-4255-abb8-31f4ed5b1a8d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.493699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4a75-6453-4255-abb8-31f4ed5b1a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.494014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4a75-6453-4255-abb8-31f4ed5b1a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.494818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca4a75-6453-4255-abb8-31f4ed5b1a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.496479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca4a75-6453-4255-abb8-31f4ed5b1a8d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.507231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1037/2080] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:41.511694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.522636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf0a4e-5fd5-45af-a598-11875559d23f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.528227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.529200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.529548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.529925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] PATH_INFO: `/v3/projects/bd1933f51c274c08b5c6e4cead252761/users/1c193ac888834a69828049057cbcc1e5/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.546793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1933f51c274c08b5c6e4cead252761, user_id=1c193ac888834a69828049057cbcc1e5, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.549533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.563531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1044/2081] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:41 2022] PUT /identity/v3/projects/bd1933f51c274c08b5c6e4cead252761/users/1c193ac888834a69828049057cbcc1e5/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:41.575143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c75491-124e-4c52-82fa-d828b8aefe09 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.575396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c75491-124e-4c52-82fa-d828b8aefe09 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.575716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c75491-124e-4c52-82fa-d828b8aefe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.604667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-95c75491-124e-4c52-82fa-d828b8aefe09 None None] MFA Rules not processed for user `1c193ac888834a69828049057cbcc1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:41.605814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-95c75491-124e-4c52-82fa-d828b8aefe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:41.675684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1038/2082] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:41.680349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.742360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1e771-eb3e-4794-a867-b0f96dc025f5 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.747666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.748372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.748657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.748952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.749680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.751713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.784791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1045/2083] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:41 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:41.791038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c75491-124e-4c52-82fa-d828b8aefe09 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.803051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c75491-124e-4c52-82fa-d828b8aefe09 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.869488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.870207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.870487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.870781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.871466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.874159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.894640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1039/2084] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:41 2022] POST /identity/v3/users => generated 306 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:41.898692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.909289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9af4d-874a-41bc-8e3b-897d1b68b14f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.914596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.915263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.915545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.915820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.916548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.918171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.925100 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.926913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:41.929580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1046/2085] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:41.933590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.939669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df86f7-c227-4774-a508-93773478a8ee admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.943614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778a08-6fe7-47a8-9b00-665b52777d51 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:41.945135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.946133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.946417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.946694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] PATH_INFO: `/v3/users/0d858d4b7d7f498cbcdfe11bfb28ef81` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.947924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d858d4b7d7f498cbcdfe11bfb28ef81)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.948882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:41.949764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:41.949877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.950046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:41.950334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] PATH_INFO: `/v3/projects/61192c52ef3d46268a3287dd092799cf/users/b9f3fc58c8a74ad09168c69e79dc24c9/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:41.967237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61192c52ef3d46268a3287dd092799cf, user_id=b9f3fc58c8a74ad09168c69e79dc24c9, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:41.969886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:41.984826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1047/2086] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:41 2022] PUT /identity/v3/projects/61192c52ef3d46268a3287dd092799cf/users/b9f3fc58c8a74ad09168c69e79dc24c9/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:41.988676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:41.999674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d858d4b7d7f498cbcdfe11bfb28ef81'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.006473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d858d4b7d7f498cbcdfe11bfb28ef81'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.007158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d858d4b7d7f498cbcdfe11bfb28ef81'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.007778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d858d4b7d7f498cbcdfe11bfb28ef81'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.019779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-58cc5795-1de8-4dc5-a3ce-b41d186ccfcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d858d4b7d7f498cbcdfe11bfb28ef81'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.035083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1040/2087] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:41 2022] DELETE /identity/v3/users/0d858d4b7d7f498cbcdfe11bfb28ef81 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:42.040125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.040498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.040777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.052239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b38c4-8fe2-4d4d-87c5-df7eb659884c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:42.058861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:42.060096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:42.108255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:42.108941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.109272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.109542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.110286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:42.111873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:42.117866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1041/2088] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:42.122214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1048/2089] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:42.126230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:42.127700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:42.130675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:42.132605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:42.139873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bd0f1-e597-4de5-bc87-96eac463ffd9 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:42.144381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b3a4c-aef6-4f55-b96c-6eac8e918515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:42.145266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b3a4c-aef6-4f55-b96c-6eac8e918515 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.145544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b3a4c-aef6-4f55-b96c-6eac8e918515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.145814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b3a4c-aef6-4f55-b96c-6eac8e918515 admin admin] PATH_INFO: `/v3/projects/61192c52ef3d46268a3287dd092799cf/users/b9f3fc58c8a74ad09168c69e79dc24c9/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.147752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b3a4c-aef6-4f55-b96c-6eac8e918515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61192c52ef3d46268a3287dd092799cf, user_id=b9f3fc58c8a74ad09168c69e79dc24c9, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:42.150386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b3a4c-aef6-4f55-b96c-6eac8e918515 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:42.160832 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1042/2090] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:42 2022] PUT /identity/v3/projects/61192c52ef3d46268a3287dd092799cf/users/b9f3fc58c8a74ad09168c69e79dc24c9/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:42.170882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.171169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.171451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.189351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d0a34-8693-4387-9123-6c9d849e827b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:42.199328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] MFA Rules not processed for user `b9f3fc58c8a74ad09168c69e79dc24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:42.200699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:42.242407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:42.243063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.243345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.243622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.281120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1043/2091] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:42.292357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:42.293962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:42.324597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:42.326173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:42.337923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1049/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:42.368930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1210f-a54e-4594-be6c-c951c2c34f27 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:42.373007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:42.373696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.374172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.374628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.388278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:42.389937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:42.403239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1044/2093] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:54:42.492158 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:42.505324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7fd31-4b0c-4515-bc98-9fa5e191689f service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:42.509317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:42.509982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.510932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.510932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.513363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:42.592610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:42.594060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:42.603472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1050/2094] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:42.646316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:42.647736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:42.662544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c852c-644a-4897-904d-15abc47f409b service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:42.667610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:42.668476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.668797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.669018 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] PATH_INFO: `/v3/projects/0cb01999621b4c67befd8af99c59b79f` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.670575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb01999621b4c67befd8af99c59b79f)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:42.672516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:42.724296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb01999621b4c67befd8af99c59b79f', 'request_id': 'req-95fb9f73-1ecc-4693-b132-c3038d68f013'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.732075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb01999621b4c67befd8af99c59b79f', 'request_id': 'req-95fb9f73-1ecc-4693-b132-c3038d68f013'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.740474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb01999621b4c67befd8af99c59b79f', 'request_id': 'req-95fb9f73-1ecc-4693-b132-c3038d68f013'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.752282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] The token cache is being invalidate because project 0cb01999621b4c67befd8af99c59b79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:42.752583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.753364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.755206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1045/2095] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:42 2022] DELETE /identity/v3/projects/0cb01999621b4c67befd8af99c59b79f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:42.759127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:42.770582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca7522-7d3b-4c49-8779-f3231bc3bfdd service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:42.839513 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:42.840403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:42.840671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:42.841070 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] PATH_INFO: `/v3/users/f8944f9e189c4a0eb7ab41d6f4268d67` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:42.842404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8944f9e189c4a0eb7ab41d6f4268d67)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:42.844297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:42.904201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8944f9e189c4a0eb7ab41d6f4268d67'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.916020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8944f9e189c4a0eb7ab41d6f4268d67'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.922603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8944f9e189c4a0eb7ab41d6f4268d67'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.931145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8944f9e189c4a0eb7ab41d6f4268d67'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.931758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-afca2524-a880-4bf5-8be3-bea533d968a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8944f9e189c4a0eb7ab41d6f4268d67'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:42.939308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1051/2096] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:42 2022] DELETE /identity/v3/users/f8944f9e189c4a0eb7ab41d6f4268d67 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:43.208355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.210014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:43.223757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb9f73-1ecc-4693-b132-c3038d68f013 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:43.278874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:43.279751 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.280038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.280307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] PATH_INFO: `/v3/projects/a53e8bc38e6f4032a2c71b6ebf3ea867` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.281458 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53e8bc38e6f4032a2c71b6ebf3ea867)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:43.283375 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:43.333211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53e8bc38e6f4032a2c71b6ebf3ea867', 'request_id': 'req-53da14bf-23fc-456c-8e15-c65d91c77c69'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:43.342547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53e8bc38e6f4032a2c71b6ebf3ea867', 'request_id': 'req-53da14bf-23fc-456c-8e15-c65d91c77c69'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:43.348950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53e8bc38e6f4032a2c71b6ebf3ea867', 'request_id': 'req-53da14bf-23fc-456c-8e15-c65d91c77c69'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:43.361232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] The token cache is being invalidate because project a53e8bc38e6f4032a2c71b6ebf3ea867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:43.361515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:43.362195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-53da14bf-23fc-456c-8e15-c65d91c77c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:43.363765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1046/2097] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:43 2022] DELETE /identity/v3/projects/a53e8bc38e6f4032a2c71b6ebf3ea867 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:43.369837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aec5e-c78f-4b77-bf5f-0fa72a5aa28d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.370434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aec5e-c78f-4b77-bf5f-0fa72a5aa28d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.370434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aec5e-c78f-4b77-bf5f-0fa72a5aa28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.389472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-cc5aec5e-c78f-4b77-bf5f-0fa72a5aa28d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:43.390709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cc5aec5e-c78f-4b77-bf5f-0fa72a5aa28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:43.450501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1052/2098] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:43.459584 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f6715-997e-4059-abef-f93f841acd3f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.459864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f6715-997e-4059-abef-f93f841acd3f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.460135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f6715-997e-4059-abef-f93f841acd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.478997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ac7f6715-997e-4059-abef-f93f841acd3f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:43.480142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ac7f6715-997e-4059-abef-f93f841acd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:43.488347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1047/2099] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:43.492589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aec5e-c78f-4b77-bf5f-0fa72a5aa28d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.502860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aec5e-c78f-4b77-bf5f-0fa72a5aa28d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:43.508567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:43.509223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.509500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.509769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.510536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:43.510841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:43.512450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:43.524882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1053/2100] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:43.529449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f6715-997e-4059-abef-f93f841acd3f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.538725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f6715-997e-4059-abef-f93f841acd3f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:43.543506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:43.544141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.544417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.544685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.545376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:43.547296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:43.574159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1048/2101] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:43 2022] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:43.578828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.593229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2107-744d-4c49-b6e1-6a9fd780a5f2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:43.650595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:43.651267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.651548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.651822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.652514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:43.654494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:43.681270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1054/2102] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:43 2022] POST /identity/v3/users => generated 279 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:43.685680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.696223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736eb40-efe1-476a-9789-832792cf137c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:43.701050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:43.701741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.702038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.702378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.703181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:43.705077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:43.716308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1049/2103] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:43.720478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.730758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c3c8c-f129-44fe-bb6b-539e999eab6a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:43.736251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b7ab9-2416-40f2-b052-83c9d93d66d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:43.736895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7ab9-2416-40f2-b052-83c9d93d66d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.737181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7ab9-2416-40f2-b052-83c9d93d66d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.737453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7ab9-2416-40f2-b052-83c9d93d66d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.738221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b7ab9-2416-40f2-b052-83c9d93d66d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:43.739870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b7ab9-2416-40f2-b052-83c9d93d66d3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:43.750419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1055/2104] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:43.754429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.769570 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b4f2b-09b5-4ddd-9387-3e72f5c34028 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:43.776055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:43.777036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.777358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.777715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] PATH_INFO: `/v3/projects/7aa99d6d06ed4d3297ba945a1ddd24a8/users/82e38d714abb4faebdf3214f21bc194e/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.793411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa99d6d06ed4d3297ba945a1ddd24a8, user_id=82e38d714abb4faebdf3214f21bc194e, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:43.796082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:43.811694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1050/2105] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:43 2022] PUT /identity/v3/projects/7aa99d6d06ed4d3297ba945a1ddd24a8/users/82e38d714abb4faebdf3214f21bc194e/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:43.823272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824e4b-e471-4816-9412-9059d7b4e407 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:43.823554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824e4b-e471-4816-9412-9059d7b4e407 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:43.823825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824e4b-e471-4816-9412-9059d7b4e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:43.851138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-65824e4b-e471-4816-9412-9059d7b4e407 None None] MFA Rules not processed for user `82e38d714abb4faebdf3214f21bc194e`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:43.852652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-65824e4b-e471-4816-9412-9059d7b4e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:43.922917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1056/2106] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:43.956649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:43.958391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:44.020857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bb817-6b12-4163-b9e7-96e43f304638 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:44.025038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3ddca-d211-48c0-bb8f-465306efcb81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:44.025686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3ddca-d211-48c0-bb8f-465306efcb81 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.025964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3ddca-d211-48c0-bb8f-465306efcb81 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.026268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3ddca-d211-48c0-bb8f-465306efcb81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.035604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3ddca-d211-48c0-bb8f-465306efcb81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:44.037025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3ddca-d211-48c0-bb8f-465306efcb81 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:44.046648 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1051/2107] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:44.060915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824e4b-e471-4816-9412-9059d7b4e407 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:44.139469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65824e4b-e471-4816-9412-9059d7b4e407 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:44.144126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:44.145002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.145287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.145557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] PATH_INFO: `/v3/users/82e38d714abb4faebdf3214f21bc194e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.146788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e38d714abb4faebdf3214f21bc194e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:44.148702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:44.197733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e38d714abb4faebdf3214f21bc194e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.210326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e38d714abb4faebdf3214f21bc194e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.218778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e38d714abb4faebdf3214f21bc194e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.227867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e38d714abb4faebdf3214f21bc194e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.228479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e38d714abb4faebdf3214f21bc194e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.235016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1057/2108] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:44 2022] DELETE /identity/v3/users/82e38d714abb4faebdf3214f21bc194e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:44.239710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.240246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.240358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.257152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:44.258366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:44.314392 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1052/2109] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:44.325811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:44.327544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:44.385812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c9b59-de1c-415d-b471-5087238c06f9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:44.389813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef0032-cf5b-4e50-b9b7-d68727dd715a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:44.390495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0032-cf5b-4e50-b9b7-d68727dd715a service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.390811 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0032-cf5b-4e50-b9b7-d68727dd715a service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.391082 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef0032-cf5b-4e50-b9b7-d68727dd715a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.400445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef0032-cf5b-4e50-b9b7-d68727dd715a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:44.401980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef0032-cf5b-4e50-b9b7-d68727dd715a service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:44.412835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1058/2110] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:44.684071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:44.685967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:44.698438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34086-b514-4230-82bd-cf8d454074b4 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:44.703553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:44.705305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.705801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.706175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] PATH_INFO: `/v3/projects/7aa99d6d06ed4d3297ba945a1ddd24a8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.707638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa99d6d06ed4d3297ba945a1ddd24a8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:44.709440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:44.759132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa99d6d06ed4d3297ba945a1ddd24a8', 'request_id': 'req-61cdda95-47a2-49fd-a659-5d3eb64a757b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.767496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa99d6d06ed4d3297ba945a1ddd24a8', 'request_id': 'req-61cdda95-47a2-49fd-a659-5d3eb64a757b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.772907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa99d6d06ed4d3297ba945a1ddd24a8', 'request_id': 'req-61cdda95-47a2-49fd-a659-5d3eb64a757b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.784015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] The token cache is being invalidate because project 7aa99d6d06ed4d3297ba945a1ddd24a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:44.784301 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.784962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-61cdda95-47a2-49fd-a659-5d3eb64a757b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:44.786554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1053/2111] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:44 2022] DELETE /identity/v3/projects/7aa99d6d06ed4d3297ba945a1ddd24a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:44.792833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b62fb-6165-4844-ba16-baf324d4c745 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.793116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b62fb-6165-4844-ba16-baf324d4c745 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.793389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b62fb-6165-4844-ba16-baf324d4c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.811748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-bd3b62fb-6165-4844-ba16-baf324d4c745 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:44.812951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bd3b62fb-6165-4844-ba16-baf324d4c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:44.874009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1059/2112] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:44.882342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27df2-cbd5-4011-86b0-b4cd0e969117 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.882659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27df2-cbd5-4011-86b0-b4cd0e969117 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.882933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27df2-cbd5-4011-86b0-b4cd0e969117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.902585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-84d27df2-cbd5-4011-86b0-b4cd0e969117 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:44.903916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-84d27df2-cbd5-4011-86b0-b4cd0e969117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:44.918349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1054/2113] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:44.922908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b62fb-6165-4844-ba16-baf324d4c745 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:44.933157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b62fb-6165-4844-ba16-baf324d4c745 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:44.938366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:44.939010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.939290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.939561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.940283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:44.940584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:44.942218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:44.953600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1060/2114] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:44.958255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27df2-cbd5-4011-86b0-b4cd0e969117 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:44.967739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27df2-cbd5-4011-86b0-b4cd0e969117 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:44.973261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:44.973955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:44.974263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:44.974536 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:44.975246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:44.977175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:45.003616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1055/2115] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:44 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:45.008435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:45.020777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ac953-79f5-4605-82fd-e556d240ac8a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:45.078025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:45.078807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:45.079232 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:45.079550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:45.080554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:45.082523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:45.105689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1061/2116] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:45 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:45.109960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:45.121741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e1f50-0164-4540-8546-d700b319aee2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:45.126454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:45.127125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:45.127410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:45.127685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:45.128419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:45.130071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:45.144662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1056/2117] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:45.145447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:45.160514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7846659-3870-4591-8d9a-2c7d7d233292 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:45.165245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f960dca-1273-496d-ad2f-9601cbb7fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:45.165937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f960dca-1273-496d-ad2f-9601cbb7fd40 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:45.166220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f960dca-1273-496d-ad2f-9601cbb7fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:45.166515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f960dca-1273-496d-ad2f-9601cbb7fd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:45.167249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f960dca-1273-496d-ad2f-9601cbb7fd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:45.168840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f960dca-1273-496d-ad2f-9601cbb7fd40 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:45.179755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1062/2118] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:45.183863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:45.193637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402cbbd-7279-4eb1-af26-a73211ecbc2d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:45.198208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:45.199094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:45.199377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:45.199648 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] PATH_INFO: `/v3/projects/55a49800dd1142f382587553add04dee/users/fa34033fad834efab58012b4180c6244/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:45.215838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a49800dd1142f382587553add04dee, user_id=fa34033fad834efab58012b4180c6244, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:45.218535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:45.232250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1057/2119] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:45 2022] PUT /identity/v3/projects/55a49800dd1142f382587553add04dee/users/fa34033fad834efab58012b4180c6244/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:45.243328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:45.243643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:45.243918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:45.270880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] MFA Rules not processed for user `fa34033fad834efab58012b4180c6244`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:45.272092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:45.339448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1063/2120] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:45.350769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:45.352468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:45.412925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b99b7-8ca7-470b-992b-06de9c027b6e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:45.416498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39dcba-93fa-4481-b03e-0f25e1646291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:45.417139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39dcba-93fa-4481-b03e-0f25e1646291 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:45.417419 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39dcba-93fa-4481-b03e-0f25e1646291 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:45.417693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39dcba-93fa-4481-b03e-0f25e1646291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:45.427372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39dcba-93fa-4481-b03e-0f25e1646291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:45.428848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39dcba-93fa-4481-b03e-0f25e1646291 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:45.438140 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1058/2121] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:46.690508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:46.693942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:46.762219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25b93-84f4-46cd-ab74-761f10c2cead None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:46.766764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:46.767659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:46.767935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:46.768202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] PATH_INFO: `/v3/users/1c193ac888834a69828049057cbcc1e5` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:46.769549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c193ac888834a69828049057cbcc1e5)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:46.771598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:46.820903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c193ac888834a69828049057cbcc1e5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:46.836116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c193ac888834a69828049057cbcc1e5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:46.850131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c193ac888834a69828049057cbcc1e5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:46.859092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c193ac888834a69828049057cbcc1e5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:46.859851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c193ac888834a69828049057cbcc1e5'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:46.872946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1064/2122] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:46 2022] DELETE /identity/v3/users/1c193ac888834a69828049057cbcc1e5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:46.877557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:46.878280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:46.878619 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:46.895632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:46.896784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:46.958000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1059/2123] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:46.967799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:46.969252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:47.028763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15631d-8169-48b7-9c6d-55928b764423 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:47.033039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:47.033686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:47.033964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:47.034275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:47.044645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:47.046153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:47.062466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1065/2124] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:47.326730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:47.328322 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:47.343424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398e069-e7e7-4a64-884b-71157e21d0b5 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:47.349096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:47.350049 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:47.350271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:47.350593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] PATH_INFO: `/v3/projects/bd1933f51c274c08b5c6e4cead252761` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:47.351903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1933f51c274c08b5c6e4cead252761)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:47.353657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:47.401870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1933f51c274c08b5c6e4cead252761', 'request_id': 'req-3a8a89d9-127e-484f-8a75-ac8d28146da4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.411302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1933f51c274c08b5c6e4cead252761', 'request_id': 'req-3a8a89d9-127e-484f-8a75-ac8d28146da4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.416630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1933f51c274c08b5c6e4cead252761', 'request_id': 'req-3a8a89d9-127e-484f-8a75-ac8d28146da4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.426958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] The token cache is being invalidate because project bd1933f51c274c08b5c6e4cead252761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:47.427237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.427849 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.429359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1060/2125] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:47 2022] DELETE /identity/v3/projects/bd1933f51c274c08b5c6e4cead252761 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:47.433678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:47.444315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7216fc-aa95-4427-b48e-4c23c9bedb62 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:47.500061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:47.500848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:47.501123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:47.501391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] PATH_INFO: `/v3/users/b9f3fc58c8a74ad09168c69e79dc24c9` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:47.502588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f3fc58c8a74ad09168c69e79dc24c9)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:47.504501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:47.553014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f3fc58c8a74ad09168c69e79dc24c9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.566054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f3fc58c8a74ad09168c69e79dc24c9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.573591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f3fc58c8a74ad09168c69e79dc24c9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.584072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f3fc58c8a74ad09168c69e79dc24c9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.585033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfff55a-86f6-423e-b0b5-03708918a79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f3fc58c8a74ad09168c69e79dc24c9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:47.591727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1066/2126] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:47 2022] DELETE /identity/v3/users/b9f3fc58c8a74ad09168c69e79dc24c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:47.880921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:47.882479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:47.896454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a89d9-127e-484f-8a75-ac8d28146da4 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:47.962262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:47.963132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:47.963447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:47.963726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] PATH_INFO: `/v3/projects/61192c52ef3d46268a3287dd092799cf` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:47.964910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61192c52ef3d46268a3287dd092799cf)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:47.966848 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.013933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61192c52ef3d46268a3287dd092799cf', 'request_id': 'req-ee58017a-e2fd-444e-842b-fcfdeb500fe1'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:48.023701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61192c52ef3d46268a3287dd092799cf', 'request_id': 'req-ee58017a-e2fd-444e-842b-fcfdeb500fe1'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:48.029348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61192c52ef3d46268a3287dd092799cf', 'request_id': 'req-ee58017a-e2fd-444e-842b-fcfdeb500fe1'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:48.052768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] The token cache is being invalidate because project 61192c52ef3d46268a3287dd092799cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:48.053062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:48.053764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ee58017a-e2fd-444e-842b-fcfdeb500fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:48.055620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1061/2127] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:47 2022] DELETE /identity/v3/projects/61192c52ef3d46268a3287dd092799cf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:48.060890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430cbf-70be-4189-8e5a-6c4774f858f6 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.061366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430cbf-70be-4189-8e5a-6c4774f858f6 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.061557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430cbf-70be-4189-8e5a-6c4774f858f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.080864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ad430cbf-70be-4189-8e5a-6c4774f858f6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:48.082074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ad430cbf-70be-4189-8e5a-6c4774f858f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:48.144152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1067/2128] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:48.151947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ff8b-94cb-416e-9801-d3c59ad825e3 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.152236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ff8b-94cb-416e-9801-d3c59ad825e3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.152513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05ff8b-94cb-416e-9801-d3c59ad825e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.172417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6d05ff8b-94cb-416e-9801-d3c59ad825e3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:48.173880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6d05ff8b-94cb-416e-9801-d3c59ad825e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:48.186339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1062/2129] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:48.190534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad430cbf-70be-4189-8e5a-6c4774f858f6 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.200213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad430cbf-70be-4189-8e5a-6c4774f858f6 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.205297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.205991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.206306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.206538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.207286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:48.207578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.209183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.223095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1068/2130] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:48.227379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05ff8b-94cb-416e-9801-d3c59ad825e3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.236421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05ff8b-94cb-416e-9801-d3c59ad825e3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.241224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.241862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.242170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.242447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.243142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.245003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.275327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1063/2131] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:48 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:48.279454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.289808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed955f9-0d64-4a55-ab97-b1fd8f364b5d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.354783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.355505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.355784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.356075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.356775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.358977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.380417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1069/2132] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:48 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:54:48.384804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.397366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2ec8d-bcce-44dd-8772-e7427d2eabf1 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.405212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.406427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.406762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.407131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.408147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.409817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.421425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1064/2133] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:48.425698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.436655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c9728-121c-47be-a3cd-645eb23caf08 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.442384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a966787-88fd-4072-8fe1-71d6e904fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.443353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a966787-88fd-4072-8fe1-71d6e904fe2d admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.443873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a966787-88fd-4072-8fe1-71d6e904fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.444327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a966787-88fd-4072-8fe1-71d6e904fe2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.445105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a966787-88fd-4072-8fe1-71d6e904fe2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.450952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a966787-88fd-4072-8fe1-71d6e904fe2d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.466097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1070/2134] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:48.471077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.481563 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d6c15-fba0-485f-9910-59530a8387c9 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.486409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.487291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.487571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.487842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] PATH_INFO: `/v3/projects/7defedeb73b542f681659226b52233e8/users/7c952e224144446cb4838a8df53386e5/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.502475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7defedeb73b542f681659226b52233e8, user_id=7c952e224144446cb4838a8df53386e5, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.505083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.521006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1065/2135] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:48 2022] PUT /identity/v3/projects/7defedeb73b542f681659226b52233e8/users/7c952e224144446cb4838a8df53386e5/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:54:48.537215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71ea1-a5b6-4748-ab7f-f2a085a3d036 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.537504 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71ea1-a5b6-4748-ab7f-f2a085a3d036 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.537782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd71ea1-a5b6-4748-ab7f-f2a085a3d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.566252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-fbd71ea1-a5b6-4748-ab7f-f2a085a3d036 None None] MFA Rules not processed for user `7c952e224144446cb4838a8df53386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:48.567445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fbd71ea1-a5b6-4748-ab7f-f2a085a3d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:48.635880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1071/2136] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:48.641686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.705984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1956d-b15a-4a9f-8654-3dfcefa2d58e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.711751 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.712453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.712738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.713012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.713733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.715676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.744254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1066/2137] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:48 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:48.750595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd71ea1-a5b6-4748-ab7f-f2a085a3d036 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.761976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd71ea1-a5b6-4748-ab7f-f2a085a3d036 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.822146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.822752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.823033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.823311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.824005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.825954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.847745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1072/2138] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:48 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:48.851771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.861989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900eaf0-a5aa-4e0a-9fd3-ed33bddb5a94 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.867130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.867697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.872653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.872936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.873872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.875509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.887370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1067/2139] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:54:48.892002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.902179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06423dd2-59fe-4782-aeee-f5216c27aac2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:48.907292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:48.908220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:48.908515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:48.908792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] PATH_INFO: `/v3/projects/e86b4dce41f7468daaccf16d44016ace/users/ea5a947cf69b43698c2edf2534c9fd62/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:48.923496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86b4dce41f7468daaccf16d44016ace, user_id=ea5a947cf69b43698c2edf2534c9fd62, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:48.926154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:48.940463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1073/2140] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:48 2022] PUT /identity/v3/projects/e86b4dce41f7468daaccf16d44016ace/users/ea5a947cf69b43698c2edf2534c9fd62/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:48.944628 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:48.955742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8237bca-1f02-4e27-8b4a-6e805b54ad55 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:49.013035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2232ef7-1f33-4ac6-8458-952daea81306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:49.013688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232ef7-1f33-4ac6-8458-952daea81306 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:49.013994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232ef7-1f33-4ac6-8458-952daea81306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:49.014300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232ef7-1f33-4ac6-8458-952daea81306 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:49.015024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2232ef7-1f33-4ac6-8458-952daea81306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:49.016607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2232ef7-1f33-4ac6-8458-952daea81306 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:49.026590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1068/2141] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:49.031170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:49.041689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb3276-9502-4d84-bb66-5ed4dceade0f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:49.046875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:49.047754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:49.048067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:49.048339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] PATH_INFO: `/v3/projects/e86b4dce41f7468daaccf16d44016ace/users/ea5a947cf69b43698c2edf2534c9fd62/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:49.050438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86b4dce41f7468daaccf16d44016ace, user_id=ea5a947cf69b43698c2edf2534c9fd62, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:49.053052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:49.063290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1074/2142] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:49 2022] PUT /identity/v3/projects/e86b4dce41f7468daaccf16d44016ace/users/ea5a947cf69b43698c2edf2534c9fd62/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:49.073632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ac600-acc2-43af-96f8-5fa40e67e23f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:49.073843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ac600-acc2-43af-96f8-5fa40e67e23f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:49.074232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ac600-acc2-43af-96f8-5fa40e67e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:49.105975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-9c5ac600-acc2-43af-96f8-5fa40e67e23f None None] MFA Rules not processed for user `ea5a947cf69b43698c2edf2534c9fd62`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:49.107227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-9c5ac600-acc2-43af-96f8-5fa40e67e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:49.175154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1069/2143] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:54:49.185648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:49.187748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:49.250251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f764d-d288-49c8-94b1-cd2725a138a1 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:49.254538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe59f9-3343-4926-b2bc-55cb88532104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:49.255272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe59f9-3343-4926-b2bc-55cb88532104 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:49.255556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe59f9-3343-4926-b2bc-55cb88532104 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:49.255815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe59f9-3343-4926-b2bc-55cb88532104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:49.265343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe59f9-3343-4926-b2bc-55cb88532104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:49.266786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe59f9-3343-4926-b2bc-55cb88532104 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:49.276345 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1075/2144] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:49.404617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ac600-acc2-43af-96f8-5fa40e67e23f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:49.465769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ac600-acc2-43af-96f8-5fa40e67e23f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:49.471397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:49.472279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:49.472562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:49.472839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] PATH_INFO: `/v3/users/7c952e224144446cb4838a8df53386e5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:49.474202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c952e224144446cb4838a8df53386e5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:49.476244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:49.527608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c952e224144446cb4838a8df53386e5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:49.534149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c952e224144446cb4838a8df53386e5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:49.534873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c952e224144446cb4838a8df53386e5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:49.535481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c952e224144446cb4838a8df53386e5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:49.547525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c952e224144446cb4838a8df53386e5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:49.560760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1070/2145] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:49 2022] DELETE /identity/v3/users/7c952e224144446cb4838a8df53386e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:49.565489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:49.565777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:49.566053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:49.585707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:49.586860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:49.645771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1076/2146] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:49.656725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:49.658487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:49.717048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c695c-23cb-4dec-b6b0-f2fe084cdd4e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:49.721108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:49.721714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:49.722004 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:49.722327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:49.733448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:49.734914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:49.745309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1071/2147] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:50.028967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:50.030496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:50.042658 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde79a-c9a7-48dd-97fb-c233bda13d3a None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:50.047692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:50.048661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:50.048939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:50.049211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] PATH_INFO: `/v3/projects/7defedeb73b542f681659226b52233e8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:50.050711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7defedeb73b542f681659226b52233e8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:50.052267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:50.105367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7defedeb73b542f681659226b52233e8', 'request_id': 'req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.114356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7defedeb73b542f681659226b52233e8', 'request_id': 'req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.119757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7defedeb73b542f681659226b52233e8', 'request_id': 'req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.131042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] The token cache is being invalidate because project 7defedeb73b542f681659226b52233e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:50.131323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.131987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.133735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1077/2148] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:50 2022] DELETE /identity/v3/projects/7defedeb73b542f681659226b52233e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:50.137864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:50.151019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f49c0d-a431-48da-a59e-c8bdccc1564d service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:50.211332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:50.212230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:50.212514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:50.212788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] PATH_INFO: `/v3/users/ea5a947cf69b43698c2edf2534c9fd62` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:50.214048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5a947cf69b43698c2edf2534c9fd62)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:50.215988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:50.271103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5a947cf69b43698c2edf2534c9fd62'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.278048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5a947cf69b43698c2edf2534c9fd62'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.278878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5a947cf69b43698c2edf2534c9fd62'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.279532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5a947cf69b43698c2edf2534c9fd62'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.290742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-80a85098-b90c-4818-b0bd-5cf08bd2d7b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5a947cf69b43698c2edf2534c9fd62'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.305517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1072/2149] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:50 2022] DELETE /identity/v3/users/ea5a947cf69b43698c2edf2534c9fd62 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:50.595494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:50.597138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:50.610944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddb6e5-a68d-4883-a19b-72d7834af9ca admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:50.672200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:50.673080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:50.673382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:50.673651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] PATH_INFO: `/v3/projects/e86b4dce41f7468daaccf16d44016ace` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:50.674866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86b4dce41f7468daaccf16d44016ace)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:50.676932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:50.738348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86b4dce41f7468daaccf16d44016ace', 'request_id': 'req-2961803c-225c-4529-a728-c828aa1859ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.749054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86b4dce41f7468daaccf16d44016ace', 'request_id': 'req-2961803c-225c-4529-a728-c828aa1859ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.757957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86b4dce41f7468daaccf16d44016ace', 'request_id': 'req-2961803c-225c-4529-a728-c828aa1859ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.774300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] The token cache is being invalidate because project e86b4dce41f7468daaccf16d44016ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:50.774711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.775466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-2961803c-225c-4529-a728-c828aa1859ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:50.777394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1078/2150] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:50 2022] DELETE /identity/v3/projects/e86b4dce41f7468daaccf16d44016ace => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:50.782698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9611-f6d8-4478-bb14-160350b2ff46 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:50.782987 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9611-f6d8-4478-bb14-160350b2ff46 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:50.783260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9611-f6d8-4478-bb14-160350b2ff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:50.802441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e0ba9611-f6d8-4478-bb14-160350b2ff46 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:50.803822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e0ba9611-f6d8-4478-bb14-160350b2ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:50.867518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1073/2151] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:50.877883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eef4eb-3ac4-42c9-89a7-64794aa64397 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:50.878140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eef4eb-3ac4-42c9-89a7-64794aa64397 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:50.878424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eef4eb-3ac4-42c9-89a7-64794aa64397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:50.897900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-73eef4eb-3ac4-42c9-89a7-64794aa64397 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:50.899289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-73eef4eb-3ac4-42c9-89a7-64794aa64397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:50.908402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1079/2152] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:50.912651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9611-f6d8-4478-bb14-160350b2ff46 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:50.923633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9611-f6d8-4478-bb14-160350b2ff46 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:50.928919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:50.929602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:50.929879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:50.930168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:50.930906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:54:50.931221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:50.932808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:50.944478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1074/2153] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:54:50.948956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eef4eb-3ac4-42c9-89a7-64794aa64397 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:50.958985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eef4eb-3ac4-42c9-89a7-64794aa64397 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:50.963731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:50.964386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:50.964675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:50.964947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:50.965641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:50.967564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:50.995899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1080/2154] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:54:50 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:51.000385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:51.010765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444c1f2-3302-4716-8d52-95db45a02ad5 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:51.073723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:51.074717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:51.075019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:51.075402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:51.076467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:51.078499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:51.102569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1075/2155] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:54:50 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:54:51.107096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:51.119964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9a71f-5eb7-4d5c-a53f-be5ff048ce5e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:51.125802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:51.126726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:51.127089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:51.127437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:51.128335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:51.130032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:51.145294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1081/2156] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:51.146769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:51.157608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df381864-f7ca-4e78-a365-47ee084a2df5 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:51.163198 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b00e5-7688-4805-b7ff-87d564ae0729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:51.163850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b00e5-7688-4805-b7ff-87d564ae0729 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:51.164132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b00e5-7688-4805-b7ff-87d564ae0729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:51.164401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b00e5-7688-4805-b7ff-87d564ae0729 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:51.165130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b00e5-7688-4805-b7ff-87d564ae0729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:51.166776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b00e5-7688-4805-b7ff-87d564ae0729 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:51.179252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1076/2157] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:54:51.183554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:51.198290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfe8b0-661d-4bce-a3b0-07b3195101c4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:51.203924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:51.205188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:51.205463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:51.205738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] PATH_INFO: `/v3/projects/cf23ab109fab4e0bb2bab91df89540e9/users/0e9350c78435408a902ec9424a38620c/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:51.225453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf23ab109fab4e0bb2bab91df89540e9, user_id=0e9350c78435408a902ec9424a38620c, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:51.228130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:51.243874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1082/2158] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:54:51 2022] PUT /identity/v3/projects/cf23ab109fab4e0bb2bab91df89540e9/users/0e9350c78435408a902ec9424a38620c/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:51.255408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:51.255700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:51.255982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:51.285704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] MFA Rules not processed for user `0e9350c78435408a902ec9424a38620c`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:51.286977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:51.363938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1077/2159] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:51.375079 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:51.376952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:51.436880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70732a-5965-4978-8fca-049bc98837dd admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:51.441018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055903-ac3f-4a14-9905-8c3e5efd9b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:51.442025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055903-ac3f-4a14-9905-8c3e5efd9b6d service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:51.442025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055903-ac3f-4a14-9905-8c3e5efd9b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:51.442420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055903-ac3f-4a14-9905-8c3e5efd9b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:51.451678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055903-ac3f-4a14-9905-8c3e5efd9b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:51.453277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055903-ac3f-4a14-9905-8c3e5efd9b6d service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:51.463427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1083/2160] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:53.501857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:53.503694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:53.575083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894599e-4aaa-414a-9d58-a6c59b819c30 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:53.580979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:53.581948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:53.582268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:53.582555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] PATH_INFO: `/v3/users/fa34033fad834efab58012b4180c6244` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:53.583867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa34033fad834efab58012b4180c6244)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:53.585880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:53.637595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa34033fad834efab58012b4180c6244'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:53.644154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa34033fad834efab58012b4180c6244'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:53.644945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa34033fad834efab58012b4180c6244'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:53.645761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa34033fad834efab58012b4180c6244'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:53.657129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa34033fad834efab58012b4180c6244'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:53.670404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1078/2161] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:53 2022] DELETE /identity/v3/users/fa34033fad834efab58012b4180c6244 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:53.675100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:53.675649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:53.675649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:53.695576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:54:53.696829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:53.756161 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1084/2162] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:54:53.766213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:53.767950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:53.832685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443ce25-7604-4f65-a9a2-aaaaab2b9102 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:53.837313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:53.837957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:53.838278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:53.838607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:53.848578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:53.850009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:53.860760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1079/2163] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:54:54.146448 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:54.147894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:54.163381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd64fd-6fd3-483d-beda-2efc3e67802e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:54.167992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:54.168890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:54.169116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:54.169382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] PATH_INFO: `/v3/projects/55a49800dd1142f382587553add04dee` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:54.170595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a49800dd1142f382587553add04dee)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:54.172572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:54:54.240000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a49800dd1142f382587553add04dee', 'request_id': 'req-7212fc08-97be-4b15-b884-92b76d5062bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:54.254966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a49800dd1142f382587553add04dee', 'request_id': 'req-7212fc08-97be-4b15-b884-92b76d5062bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:54.262305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a49800dd1142f382587553add04dee', 'request_id': 'req-7212fc08-97be-4b15-b884-92b76d5062bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:54.274648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] The token cache is being invalidate because project 55a49800dd1142f382587553add04dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:54:54.274929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:54.275614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7212fc08-97be-4b15-b884-92b76d5062bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:54:54.277229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1085/2164] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:54:54 2022] DELETE /identity/v3/projects/55a49800dd1142f382587553add04dee => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:54:59.900799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:54:59.902407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:54:59.915810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1934-f2ba-401e-b680-cc0ad0741d23 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:54:59.972734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:54:59.973600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:54:59.973875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:54:59.974179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] PATH_INFO: `/v3/users/0e9350c78435408a902ec9424a38620c` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:54:59.975345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9350c78435408a902ec9424a38620c)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:54:59.977312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:00.024935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9350c78435408a902ec9424a38620c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.032889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9350c78435408a902ec9424a38620c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.033634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9350c78435408a902ec9424a38620c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.034403 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9350c78435408a902ec9424a38620c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.049254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9350c78435408a902ec9424a38620c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.066332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1080/2165] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:54:59 2022] DELETE /identity/v3/users/0e9350c78435408a902ec9424a38620c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:55:00.071087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.071598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.071719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.097150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:00.098351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:00.162523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1086/2166] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:00.172812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:00.175019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:00.238343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f6e8-53da-4ecc-8ef9-bdbf2a4ae203 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:00.242219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a994d-d772-435c-9c5e-2f4d0f102dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:00.242898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a994d-d772-435c-9c5e-2f4d0f102dba service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.243177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a994d-d772-435c-9c5e-2f4d0f102dba service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.243454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a994d-d772-435c-9c5e-2f4d0f102dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.252831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a994d-d772-435c-9c5e-2f4d0f102dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:00.254401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a994d-d772-435c-9c5e-2f4d0f102dba service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:00.266264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1081/2167] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:55:00.536870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:00.538514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:00.551317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba39fe-ab73-4f4d-bd92-05a4cc80759c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:00.556953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:00.557822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.558125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.558451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] PATH_INFO: `/v3/projects/cf23ab109fab4e0bb2bab91df89540e9` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.559734 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf23ab109fab4e0bb2bab91df89540e9)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:00.561782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:00.607597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf23ab109fab4e0bb2bab91df89540e9', 'request_id': 'req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.615947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf23ab109fab4e0bb2bab91df89540e9', 'request_id': 'req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.621697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf23ab109fab4e0bb2bab91df89540e9', 'request_id': 'req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.632836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] The token cache is being invalidate because project cf23ab109fab4e0bb2bab91df89540e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:55:00.633116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.633792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4ace5cbb-3ae9-4e8b-bd54-118d7aec7c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:55:00.635390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1087/2168] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:55:00 2022] DELETE /identity/v3/projects/cf23ab109fab4e0bb2bab91df89540e9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:55:00.640343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df141d-6017-4abd-b3b9-77b96dadd50e None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.640616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df141d-6017-4abd-b3b9-77b96dadd50e None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.640886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df141d-6017-4abd-b3b9-77b96dadd50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.659467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-47df141d-6017-4abd-b3b9-77b96dadd50e None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:00.660669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-47df141d-6017-4abd-b3b9-77b96dadd50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:00.722383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1082/2169] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:00.730389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebabc5-c885-4b7d-9329-977ba6662eb4 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.730660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebabc5-c885-4b7d-9329-977ba6662eb4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.730958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebabc5-c885-4b7d-9329-977ba6662eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.748944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-0bebabc5-c885-4b7d-9329-977ba6662eb4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:00.750115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0bebabc5-c885-4b7d-9329-977ba6662eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:00.758391 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1088/2170] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:00.762384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df141d-6017-4abd-b3b9-77b96dadd50e None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:00.773669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df141d-6017-4abd-b3b9-77b96dadd50e None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:00.781614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:00.782747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.783097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.783462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.784675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:55:00.784982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:00.786600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:00.798816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1083/2171] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:55:00.803217 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebabc5-c885-4b7d-9329-977ba6662eb4 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:00.812851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebabc5-c885-4b7d-9329-977ba6662eb4 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:00.818731 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:00.819384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.819666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.819942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.820664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:00.822611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:00.851512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1089/2172] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:55:00 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:55:00.855861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:00.865768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3a1b3-e3a6-477f-9c3c-979c4e8326a0 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:00.922125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:00.922881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.923235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.923577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.924375 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:00.926476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:00.948162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1084/2173] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:55:00 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:55:00.952528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:00.963471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82f2ed-6b0b-4a87-a324-a9c88872fb84 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:00.968862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:00.969530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:00.969819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:00.970111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:00.970887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:00.972554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:00.982949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1090/2174] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:55:00.986860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:00.996668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7445e65-2b7a-4b51-aeed-fe0ee018152b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:01.001209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9042f2-738b-4977-9f5e-500db86256ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:01.001853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9042f2-738b-4977-9f5e-500db86256ea admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:01.002240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9042f2-738b-4977-9f5e-500db86256ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:01.002513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9042f2-738b-4977-9f5e-500db86256ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:01.003276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9042f2-738b-4977-9f5e-500db86256ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:01.004852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9042f2-738b-4977-9f5e-500db86256ea admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:01.014546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1085/2175] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:55:01.018663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:01.031724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2dc18-9677-49f5-925f-ef1741c6070e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:01.039828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:01.040945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:01.041316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:01.041733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] PATH_INFO: `/v3/projects/acb3194551f14d53b537ed3a0a5ad6df/users/a3be90653c4d45209f0f6f98cf034036/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:01.059460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb3194551f14d53b537ed3a0a5ad6df, user_id=a3be90653c4d45209f0f6f98cf034036, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:01.062166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:01.077325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1091/2176] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:55:01 2022] PUT /identity/v3/projects/acb3194551f14d53b537ed3a0a5ad6df/users/a3be90653c4d45209f0f6f98cf034036/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:55:01.083310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e9aab-0a3c-4fa4-b07f-f0210b9b52ba None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:01.083619 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e9aab-0a3c-4fa4-b07f-f0210b9b52ba None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:01.083893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e9aab-0a3c-4fa4-b07f-f0210b9b52ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:01.102519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a87e9aab-0a3c-4fa4-b07f-f0210b9b52ba None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:01.103737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a87e9aab-0a3c-4fa4-b07f-f0210b9b52ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:01.167842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1086/2177] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:01.184125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:01.186076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:01.243067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536838a1-bafb-4571-8161-55d2720b453f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:01.246896 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:01.247542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:01.247838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:01.248117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:01.257410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:01.258884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:01.268729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1092/2178] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:55:02.103022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828c8f-6612-4f9f-a924-e219bf363745 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:02.103660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828c8f-6612-4f9f-a924-e219bf363745 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:02.103859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26828c8f-6612-4f9f-a924-e219bf363745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:02.134731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-26828c8f-6612-4f9f-a924-e219bf363745 None None] MFA Rules not processed for user `a3be90653c4d45209f0f6f98cf034036`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:02.136372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-26828c8f-6612-4f9f-a924-e219bf363745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:02.223086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1087/2179] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:02.233777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:02.235337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:02.297078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2c74-6350-4dd9-8aed-8d93d5d7d2ee service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:02.300951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b908d4-4d38-4891-9483-7feedf64cd37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:02.301961 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b908d4-4d38-4891-9483-7feedf64cd37 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:02.302442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b908d4-4d38-4891-9483-7feedf64cd37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:02.302870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b908d4-4d38-4891-9483-7feedf64cd37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:02.314527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b908d4-4d38-4891-9483-7feedf64cd37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:02.316278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b908d4-4d38-4891-9483-7feedf64cd37 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:02.326549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1093/2180] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:55:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:55:03.697390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3264f-ee00-4d1b-ab50-1f1972435c16 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:03.698041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3264f-ee00-4d1b-ab50-1f1972435c16 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:03.698041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3264f-ee00-4d1b-ab50-1f1972435c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:03.719639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-56b3264f-ee00-4d1b-ab50-1f1972435c16 None None] MFA Rules not processed for user `a3be90653c4d45209f0f6f98cf034036`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:03.721269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-56b3264f-ee00-4d1b-ab50-1f1972435c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:03.728650 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1088/2181] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:16.981455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127fdd3-585e-4119-9329-6d872b6d409a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:16.982105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127fdd3-585e-4119-9329-6d872b6d409a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:16.982105 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127fdd3-585e-4119-9329-6d872b6d409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:17.001445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3127fdd3-585e-4119-9329-6d872b6d409a None None] MFA Rules not processed for user `4f558c4579064393afc9d5cb58eacdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:17.002753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3127fdd3-585e-4119-9329-6d872b6d409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:17.055852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1094/2182] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:30.083492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f036-37c9-4b90-a8f0-151f0cd3bda1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:30.084062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f036-37c9-4b90-a8f0-151f0cd3bda1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:30.084062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f036-37c9-4b90-a8f0-151f0cd3bda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:30.103810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3295f036-37c9-4b90-a8f0-151f0cd3bda1 None None] MFA Rules not processed for user `a3be90653c4d45209f0f6f98cf034036`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:30.105010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3295f036-37c9-4b90-a8f0-151f0cd3bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:30.112786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1089/2183] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:32.492704 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:32.493367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:32.493367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:32.511971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] MFA Rules not processed for user `212d3a1984a34761a3b06eff9f26d44f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:32.513390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:32.567506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1095/2184] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:48.996468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6117-7905-4efc-92bc-90a8c202a67a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:48.997008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6117-7905-4efc-92bc-90a8c202a67a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:48.997008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6117-7905-4efc-92bc-90a8c202a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:49.026124 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-328b6117-7905-4efc-92bc-90a8c202a67a None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:49.027361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-328b6117-7905-4efc-92bc-90a8c202a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:49.128333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1090/2185] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:55:49.185742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:55:49.187201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:49.287777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ef472-4f94-48c0-9b18-e8b64f734fa3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:55:49.292973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cfef9-229d-4979-b34e-fda4b6afc960 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:55:49.293616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfef9-229d-4979-b34e-fda4b6afc960 service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:49.293944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfef9-229d-4979-b34e-fda4b6afc960 service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:49.294259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cfef9-229d-4979-b34e-fda4b6afc960 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:49.303578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cfef9-229d-4979-b34e-fda4b6afc960 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:55:49.305237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cfef9-229d-4979-b34e-fda4b6afc960 service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:55:49.313302 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1096/2186] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:55:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 24 14:55:54.113684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576f3a-6ead-405e-a339-9709145b31bd None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:55:54.114325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576f3a-6ead-405e-a339-9709145b31bd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:55:54.114676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576f3a-6ead-405e-a339-9709145b31bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:55:54.135441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4b576f3a-6ead-405e-a339-9709145b31bd None None] MFA Rules not processed for user `2f02fe7241df4201a5ff0293cff2557c`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:55:54.137078 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4b576f3a-6ead-405e-a339-9709145b31bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:55:54.203370 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1091/2187] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:01.167270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc0bc3-6f52-4099-8c49-e656aca7bc6c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:01.167841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc0bc3-6f52-4099-8c49-e656aca7bc6c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:01.167841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc0bc3-6f52-4099-8c49-e656aca7bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:01.197682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1cdc0bc3-6f52-4099-8c49-e656aca7bc6c None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:01.198998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1cdc0bc3-6f52-4099-8c49-e656aca7bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:01.214531 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1097/2188] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:56:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:01.227081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b576f3a-6ead-405e-a339-9709145b31bd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:01.243246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b576f3a-6ead-405e-a339-9709145b31bd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:01.249091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13ed2d-cb21-49e5-8626-01a50a2b919b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:01.249847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13ed2d-cb21-49e5-8626-01a50a2b919b service swift] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:01.250244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13ed2d-cb21-49e5-8626-01a50a2b919b service swift] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:01.250585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13ed2d-cb21-49e5-8626-01a50a2b919b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:01.259633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13ed2d-cb21-49e5-8626-01a50a2b919b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:01.261343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13ed2d-cb21-49e5-8626-01a50a2b919b service swift] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:01.270143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1092/2189] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:56:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:56:05.191599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e728e-174e-44e0-8c84-eaf5145e577f None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.192181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e728e-174e-44e0-8c84-eaf5145e577f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.192181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e728e-174e-44e0-8c84-eaf5145e577f None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:05.194468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1098/2190] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:56:05.203263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548eb0-596a-44d9-91a8-799ce04c3ece None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.203732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548eb0-596a-44d9-91a8-799ce04c3ece None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.204041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548eb0-596a-44d9-91a8-799ce04c3ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:05.338683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c8548eb0-596a-44d9-91a8-799ce04c3ece None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:05.339925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c8548eb0-596a-44d9-91a8-799ce04c3ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:05.439667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1093/2191] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:05.451368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e728e-174e-44e0-8c84-eaf5145e577f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:05.455224 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e65e728e-174e-44e0-8c84-eaf5145e577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:05.536611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e728e-174e-44e0-8c84-eaf5145e577f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:05.540705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cabc43-e14a-4d61-8f65-65b0a7c51dc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:05.541690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cabc43-e14a-4d61-8f65-65b0a7c51dc6 service glance] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.542276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cabc43-e14a-4d61-8f65-65b0a7c51dc6 service glance] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.542768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cabc43-e14a-4d61-8f65-65b0a7c51dc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:05.555879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cabc43-e14a-4d61-8f65-65b0a7c51dc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:05.557468 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cabc43-e14a-4d61-8f65-65b0a7c51dc6 service glance] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:05.568974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1099/2192] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:56:05.683672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437aca-e73c-419c-9c7d-07e12523be4a None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.684055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437aca-e73c-419c-9c7d-07e12523be4a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.684241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9437aca-e73c-419c-9c7d-07e12523be4a None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:05.686421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1094/2193] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:56:05.696705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095477-8df7-4de0-8573-4fd172534394 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.697431 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095477-8df7-4de0-8573-4fd172534394 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.697782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095477-8df7-4de0-8573-4fd172534394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:05.769836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f0095477-8df7-4de0-8573-4fd172534394 None None] MFA Rules not processed for user `750a6a7b35204c47ac16a584e7e71713`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:05.772356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f0095477-8df7-4de0-8573-4fd172534394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:05.799109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1100/2194] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:05.812401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437aca-e73c-419c-9c7d-07e12523be4a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:05.814679 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f9437aca-e73c-419c-9c7d-07e12523be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:05.830634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9437aca-e73c-419c-9c7d-07e12523be4a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:05.834901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6dfd1-e526-434d-a1cd-ad91d8de9bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:05.835931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6dfd1-e526-434d-a1cd-ad91d8de9bdc service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.836451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6dfd1-e526-434d-a1cd-ad91d8de9bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.836920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6dfd1-e526-434d-a1cd-ad91d8de9bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:05.845753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6dfd1-e526-434d-a1cd-ad91d8de9bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:05.847493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6dfd1-e526-434d-a1cd-ad91d8de9bdc service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:05.858982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1095/2195] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:56:05.973091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed068c2-1f9c-4040-aab6-d7ec2f818e7b None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.973639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed068c2-1f9c-4040-aab6-d7ec2f818e7b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.974121 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed068c2-1f9c-4040-aab6-d7ec2f818e7b None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:05.976280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1101/2196] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 24 14:56:05.984933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14062-8458-4395-b776-2203b11fd7b4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:05.985468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14062-8458-4395-b776-2203b11fd7b4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:05.985468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e14062-8458-4395-b776-2203b11fd7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:06.010387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-82e14062-8458-4395-b776-2203b11fd7b4 None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:06.012118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-82e14062-8458-4395-b776-2203b11fd7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:06.028117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1096/2197] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:56:06.038626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed068c2-1f9c-4040-aab6-d7ec2f818e7b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:06.051549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed068c2-1f9c-4040-aab6-d7ec2f818e7b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:06.056214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:06.056872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:06.057158 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:06.057470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:06.070626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:06.072244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:06.103902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1102/2198] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:56:10.236978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732fda3-2fd6-4c0f-a80b-a9b20e8e0d51 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:10.237504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732fda3-2fd6-4c0f-a80b-a9b20e8e0d51 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:10.237672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732fda3-2fd6-4c0f-a80b-a9b20e8e0d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:10.257391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f732fda3-2fd6-4c0f-a80b-a9b20e8e0d51 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:10.258937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f732fda3-2fd6-4c0f-a80b-a9b20e8e0d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:10.267038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1097/2199] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:10.294920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:10.309439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff3af3-eaf2-4415-8813-9877b95514ce service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:10.319108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:10.319892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:10.320389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:10.320966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:10.332225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:10.334226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:10.346818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1103/2200] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:56:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:56:18.193816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71043b-d06a-4152-8112-42ec57cd2ce8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:18.194432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71043b-d06a-4152-8112-42ec57cd2ce8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:18.194432 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71043b-d06a-4152-8112-42ec57cd2ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:18.212587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-cd71043b-d06a-4152-8112-42ec57cd2ce8 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:18.213715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-cd71043b-d06a-4152-8112-42ec57cd2ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:18.221397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1098/2201] 10.222.0.43 () {58 vars in 967 bytes} [Thu Mar 24 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:56:18.234523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:18.246135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562ae7b-30f4-46b9-8e53-f1b83eeaef6b service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:18.251423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:18.252842 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:18.253148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:18.253444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:18.262941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:18.264607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:18.285420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1104/2202] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:56:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:56:20.239589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71043b-d06a-4152-8112-42ec57cd2ce8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:20.283964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71043b-d06a-4152-8112-42ec57cd2ce8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:20.288882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:20.289807 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:20.290131 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:20.290425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] PATH_INFO: `/v3/users/a3be90653c4d45209f0f6f98cf034036` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:20.291797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3be90653c4d45209f0f6f98cf034036)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:20.293722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:20.344462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3be90653c4d45209f0f6f98cf034036'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.351175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3be90653c4d45209f0f6f98cf034036'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.351854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3be90653c4d45209f0f6f98cf034036'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.352426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3be90653c4d45209f0f6f98cf034036'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.363378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-04458aed-8621-485b-8d1e-52c9c0ba9e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3be90653c4d45209f0f6f98cf034036'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.378139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1099/2203] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:56:20 2022] DELETE /identity/v3/users/a3be90653c4d45209f0f6f98cf034036 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:56:20.556695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:20.567378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b32be-3142-4afe-b9ae-64c7dbc90b8d service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:20.646012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:20.647110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:20.647545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:20.647878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] PATH_INFO: `/v3/projects/acb3194551f14d53b537ed3a0a5ad6df` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:20.649149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb3194551f14d53b537ed3a0a5ad6df)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:20.652500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:20.710204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb3194551f14d53b537ed3a0a5ad6df', 'request_id': 'req-4d6613e1-1120-443e-bc80-b83fa408ec45'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.722519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb3194551f14d53b537ed3a0a5ad6df', 'request_id': 'req-4d6613e1-1120-443e-bc80-b83fa408ec45'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.728487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb3194551f14d53b537ed3a0a5ad6df', 'request_id': 'req-4d6613e1-1120-443e-bc80-b83fa408ec45'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.751417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] The token cache is being invalidate because project acb3194551f14d53b537ed3a0a5ad6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:56:20.751699 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.752309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4d6613e1-1120-443e-bc80-b83fa408ec45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:56:20.753820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1105/2204] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:56:20 2022] DELETE /identity/v3/projects/acb3194551f14d53b537ed3a0a5ad6df => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:56:20.758710 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454974-622c-4b16-9806-231bbd03bc2f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:20.758997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454974-622c-4b16-9806-231bbd03bc2f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:20.759270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454974-622c-4b16-9806-231bbd03bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:20.804548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-1c454974-622c-4b16-9806-231bbd03bc2f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:20.805699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1c454974-622c-4b16-9806-231bbd03bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:20.874690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1100/2205] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:20.882288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445398-b50c-4cc3-9878-52b7875687e5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:20.883042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445398-b50c-4cc3-9878-52b7875687e5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:20.883487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94445398-b50c-4cc3-9878-52b7875687e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:20.910889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-94445398-b50c-4cc3-9878-52b7875687e5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:20.912092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-94445398-b50c-4cc3-9878-52b7875687e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:20.920170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1106/2206] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:20.924492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454974-622c-4b16-9806-231bbd03bc2f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:20.934028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454974-622c-4b16-9806-231bbd03bc2f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:20.938517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:20.939168 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:20.939446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:20.939716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:20.940436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:56:20.940738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:20.942351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:20.954981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1101/2207] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 14:56:20.959326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445398-b50c-4cc3-9878-52b7875687e5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:20.968974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94445398-b50c-4cc3-9878-52b7875687e5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:20.974073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:20.974766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:20.975054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:20.975338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:20.976036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:20.977977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:21.010123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1107/2208] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:56:20 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:56:21.012758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:21.022674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e88924-85cc-4baa-bf5f-e22dc71f3e21 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:21.082235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:21.083145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:21.083537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:21.083925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:21.084859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:21.087218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:21.114577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1102/2209] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:56:21 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:56:21.115943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:21.126657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab171f1-478b-465f-9015-0839729a79b0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:21.132591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:21.133260 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:21.133543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:21.133814 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:21.134584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:21.136197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:21.146776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1108/2210] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:56:21.151081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:21.161723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ab7a8-ee63-4c5d-9187-07a906225021 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:21.166593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c0a61-8357-4748-a177-e4ab124def0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:21.167244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c0a61-8357-4748-a177-e4ab124def0c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:21.167531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c0a61-8357-4748-a177-e4ab124def0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:21.167804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c0a61-8357-4748-a177-e4ab124def0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:21.168533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c0a61-8357-4748-a177-e4ab124def0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:21.170208 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c0a61-8357-4748-a177-e4ab124def0c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:21.179957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1103/2211] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:56:21.183973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:21.194669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf85b8-a395-4c22-8a19-f4a3240a7cc1 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:21.200024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:21.200937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:21.201216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:21.201493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] PATH_INFO: `/v3/projects/74c9cf6084644422ad635eb87dd6452c/users/41dfdf8fe0724bc39a9f255a7199a15d/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:21.216460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c9cf6084644422ad635eb87dd6452c, user_id=41dfdf8fe0724bc39a9f255a7199a15d, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:21.219150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:21.232434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1109/2212] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:56:21 2022] PUT /identity/v3/projects/74c9cf6084644422ad635eb87dd6452c/users/41dfdf8fe0724bc39a9f255a7199a15d/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:56:21.242475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:21.243015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:21.243015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:21.273393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] MFA Rules not processed for user `41dfdf8fe0724bc39a9f255a7199a15d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:21.274638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:21.339914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1104/2213] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:21.351501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:21.353248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:21.412633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709967-32a8-431e-b331-6ce2bbc10055 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:21.417031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a85ee-b581-4b65-81b8-3d9f1332de82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:21.417673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a85ee-b581-4b65-81b8-3d9f1332de82 service glance] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:21.417958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a85ee-b581-4b65-81b8-3d9f1332de82 service glance] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:21.418258 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a85ee-b581-4b65-81b8-3d9f1332de82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:21.426909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a85ee-b581-4b65-81b8-3d9f1332de82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:21.428341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a85ee-b581-4b65-81b8-3d9f1332de82 service glance] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:21.437229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1110/2214] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:56:23.629553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:23.631193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:23.727448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289b218-f86f-46a3-91e6-f9c06ceaafe3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:23.734122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca33f2f8bb0a4631912f0ed51c6f8c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:23.734784 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:23.735066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:23.735342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:23.737510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:23.749597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:23.751210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:23.762016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1105/2215] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:56:41.461923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb40c-20fb-4220-a837-e2b01d8bf416 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:41.462462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb40c-20fb-4220-a837-e2b01d8bf416 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:41.462462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb40c-20fb-4220-a837-e2b01d8bf416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:41.517613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-23dcb40c-20fb-4220-a837-e2b01d8bf416 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:56:41.518877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-23dcb40c-20fb-4220-a837-e2b01d8bf416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:41.584885 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1111/2216] 10.222.0.43 () {58 vars in 967 bytes} [Thu Mar 24 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:56:41.598016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:56:41.599523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:56:41.693571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dba5b0-566d-4aab-9846-782fa61c84ab service placement] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:56:41.699190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:56:41.700070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:56:41.700601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:56:41.700776 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:56:41.712072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:56:41.713691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:56:41.721999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1106/2217] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:56:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:57:03.250820 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d7220-bde7-4934-80e6-fa42c30e542e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:03.251384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d7220-bde7-4934-80e6-fa42c30e542e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:03.251384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d7220-bde7-4934-80e6-fa42c30e542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:03.269767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d68d7220-bde7-4934-80e6-fa42c30e542e None None] MFA Rules not processed for user `4f558c4579064393afc9d5cb58eacdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:03.270964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d68d7220-bde7-4934-80e6-fa42c30e542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:03.326660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1112/2218] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:08.512148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:08.581969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07770-be73-4385-ac53-904c8fb14689 service swift] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:08.586445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:08.587316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:08.587588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:08.587859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] PATH_INFO: `/v3/users/41dfdf8fe0724bc39a9f255a7199a15d` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:08.589069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dfdf8fe0724bc39a9f255a7199a15d)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:08.591021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:08.637558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dfdf8fe0724bc39a9f255a7199a15d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:08.644217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dfdf8fe0724bc39a9f255a7199a15d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:08.644878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dfdf8fe0724bc39a9f255a7199a15d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:08.645573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dfdf8fe0724bc39a9f255a7199a15d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:08.656815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dfdf8fe0724bc39a9f255a7199a15d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:08.672334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1107/2219] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:57:08 2022] DELETE /identity/v3/users/41dfdf8fe0724bc39a9f255a7199a15d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:08.678877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:08.679400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:08.679507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:08.697138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:08.698389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:08.760072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1113/2220] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:57:08.769846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:08.771502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:08.830824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540282-4448-44c7-b87e-80021f8e69a5 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:08.837189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d40e4-626d-450f-9cd0-47e7aeced1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:08.838212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d40e4-626d-450f-9cd0-47e7aeced1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:08.838630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d40e4-626d-450f-9cd0-47e7aeced1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:08.838980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d40e4-626d-450f-9cd0-47e7aeced1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:08.851057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d40e4-626d-450f-9cd0-47e7aeced1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:08.852522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d40e4-626d-450f-9cd0-47e7aeced1f4 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:08.862615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1108/2221] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:57:09.133570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.135050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:09.148305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082965a-7d10-4464-95d9-0b0aefdfe2e5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.154443 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.155360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.156859 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.157222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] PATH_INFO: `/v3/projects/74c9cf6084644422ad635eb87dd6452c` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.158881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c9cf6084644422ad635eb87dd6452c)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.160809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.212748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c9cf6084644422ad635eb87dd6452c', 'request_id': 'req-194d7311-7bc5-4512-9ebe-d1a3224a6205'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:09.221185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c9cf6084644422ad635eb87dd6452c', 'request_id': 'req-194d7311-7bc5-4512-9ebe-d1a3224a6205'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:09.227395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c9cf6084644422ad635eb87dd6452c', 'request_id': 'req-194d7311-7bc5-4512-9ebe-d1a3224a6205'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:09.239229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] The token cache is being invalidate because project 74c9cf6084644422ad635eb87dd6452c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:57:09.239673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:09.240479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-194d7311-7bc5-4512-9ebe-d1a3224a6205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:09.242115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1114/2222] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:57:09 2022] DELETE /identity/v3/projects/74c9cf6084644422ad635eb87dd6452c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:09.247180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092cdb-7ab9-4be3-91fe-8b74be1e702d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.247466 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092cdb-7ab9-4be3-91fe-8b74be1e702d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.247775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092cdb-7ab9-4be3-91fe-8b74be1e702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.266141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a7092cdb-7ab9-4be3-91fe-8b74be1e702d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:09.267416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a7092cdb-7ab9-4be3-91fe-8b74be1e702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:09.327585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1109/2223] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:57:09.336604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0502-bfde-491c-b274-b53181060c1c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.336899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0502-bfde-491c-b274-b53181060c1c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.337212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a0502-bfde-491c-b274-b53181060c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.355310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-280a0502-bfde-491c-b274-b53181060c1c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:09.356528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-280a0502-bfde-491c-b274-b53181060c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:09.365274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1115/2224] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:09.369540 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092cdb-7ab9-4be3-91fe-8b74be1e702d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.379769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092cdb-7ab9-4be3-91fe-8b74be1e702d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.385009 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.385684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.385997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.386384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.387117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:57:09.387435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.389088 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.401761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1110/2225] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:57:09.406312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a0502-bfde-491c-b274-b53181060c1c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.415788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a0502-bfde-491c-b274-b53181060c1c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.421130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.422050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.422376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.422648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.423338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.425229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.453870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1116/2226] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:57:09 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:57:09.456250 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.466744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801ffab-98b8-48e0-a13b-5399d4bdc615 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.522912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.523573 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.523862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.524141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.524856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.526817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.553117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1111/2227] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:57:09 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:57:09.554415 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.565767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d72f6-2638-4e7a-8f2d-39fadc0c41e9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.584071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.584816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.585100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.586975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.586975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.588134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.602761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1117/2228] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:57:09.604059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.614517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a655e7-bf1a-4431-8f64-320d66cb4587 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.619636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd50487-02d9-4179-8fd5-afca348411ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.620305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50487-02d9-4179-8fd5-afca348411ec admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.620616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50487-02d9-4179-8fd5-afca348411ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.620857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50487-02d9-4179-8fd5-afca348411ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.621884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd50487-02d9-4179-8fd5-afca348411ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.623589 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd50487-02d9-4179-8fd5-afca348411ec admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.637169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1112/2229] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:57:09.639128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.649131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26860150-e110-41fa-9edd-d8eb1c2ad41f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.654409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.655599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.655963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.656167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] PATH_INFO: `/v3/projects/064f289f92414a78b832c412131fc63a/users/676ff129731e4de7ad16b64d52dce9ed/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.676408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064f289f92414a78b832c412131fc63a, user_id=676ff129731e4de7ad16b64d52dce9ed, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.679099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.701335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1118/2230] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:57:09 2022] PUT /identity/v3/projects/064f289f92414a78b832c412131fc63a/users/676ff129731e4de7ad16b64d52dce9ed/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:57:09.706756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d6d9a-4931-4e35-86ce-9dee589129da None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.707113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d6d9a-4931-4e35-86ce-9dee589129da None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.707476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d6d9a-4931-4e35-86ce-9dee589129da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.725121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c77d6d9a-4931-4e35-86ce-9dee589129da None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:09.726440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c77d6d9a-4931-4e35-86ce-9dee589129da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:09.783279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1113/2231] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:57:09.792980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:09.794874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:09.857546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f9415-19df-4e55-9a6f-9694943f0b42 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:09.861488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:09.862158 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:09.862851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:09.863424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:09.877164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:09.878660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:09.888674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1119/2232] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:57:16.487199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37896d9-6b02-47c1-afae-e79704d142e2 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:16.487996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37896d9-6b02-47c1-afae-e79704d142e2 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:16.488284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37896d9-6b02-47c1-afae-e79704d142e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:16.532567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a37896d9-6b02-47c1-afae-e79704d142e2 None None] MFA Rules not processed for user `676ff129731e4de7ad16b64d52dce9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:16.534127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a37896d9-6b02-47c1-afae-e79704d142e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:16.663716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1114/2233] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:16.668425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:16.680474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8500a0a-90cb-4f49-97b2-370e0d4f5a4d service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:16.685631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:16.686400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:16.686688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:16.687110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:16.688057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:16.689965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:16.722121 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1120/2234] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:57:16 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:57:16.723730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37896d9-6b02-47c1-afae-e79704d142e2 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:16.734376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37896d9-6b02-47c1-afae-e79704d142e2 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:16.791363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:16.792073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:16.792424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:16.792713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:16.793427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:16.795403 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:16.819110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1115/2235] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:57:16 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:57:16.820481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:16.831790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd13a14-523b-43ae-85c1-4c679b3b0c3f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:16.837491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:16.838227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:16.838507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:16.838777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:16.839503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:16.841182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:16.854225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1121/2236] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:57:16.857267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:16.872254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f28d-2c9c-4524-af78-8fbc2de0fd50 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:16.878029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:16.878961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:16.879241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:16.879515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] PATH_INFO: `/v3/projects/f166c33786ea437b9c5b41459626dcc9/users/080ad9bb44024051a66e2887c6c3a8dd/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:16.896258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f166c33786ea437b9c5b41459626dcc9, user_id=080ad9bb44024051a66e2887c6c3a8dd, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:16.900097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:16.916378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1116/2237] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:57:16 2022] PUT /identity/v3/projects/f166c33786ea437b9c5b41459626dcc9/users/080ad9bb44024051a66e2887c6c3a8dd/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:16.920557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:16.930953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cb02d-2494-45db-b53b-d2b9e24272c6 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:16.993204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:16.993959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:16.994267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:16.994540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:16.995890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:16.998252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:17.011175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1122/2238] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:57:17.015813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:17.031925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69929ef3-1a3b-44ea-8ab5-4e73fcee63fa admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:17.036951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:17.037941 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:17.038320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:17.038660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] PATH_INFO: `/v3/projects/f166c33786ea437b9c5b41459626dcc9/users/080ad9bb44024051a66e2887c6c3a8dd/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:17.040889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f166c33786ea437b9c5b41459626dcc9, user_id=080ad9bb44024051a66e2887c6c3a8dd, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:17.043778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:17.061908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1117/2239] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:57:17 2022] PUT /identity/v3/projects/f166c33786ea437b9c5b41459626dcc9/users/080ad9bb44024051a66e2887c6c3a8dd/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:57:17.368265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:17.373924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:17.411467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca67856-c57d-44f1-ae1e-0528eab49a5f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:17.515333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:17.516366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:17.516776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:17.517144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] PATH_INFO: `/v3/users/2f02fe7241df4201a5ff0293cff2557c` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:17.518470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f02fe7241df4201a5ff0293cff2557c)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:17.521676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:17.603470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f02fe7241df4201a5ff0293cff2557c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:17.629574 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f02fe7241df4201a5ff0293cff2557c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:17.644038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f02fe7241df4201a5ff0293cff2557c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:17.667300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f02fe7241df4201a5ff0293cff2557c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:17.668469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d07936c5-711e-4d03-8f30-4c5852dc5c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f02fe7241df4201a5ff0293cff2557c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:17.680743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1123/2240] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:57:17 2022] DELETE /identity/v3/users/2f02fe7241df4201a5ff0293cff2557c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:18.097350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:18.100269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:18.120082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd07e6d-b56b-4d5e-a62f-547d5344ab53 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:18.220412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:18.221211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:18.221492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:18.221767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] PATH_INFO: `/v3/projects/dcf4fbcb56b84e6a96801d771f325883` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:18.223008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf4fbcb56b84e6a96801d771f325883)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:18.224909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:18.290162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf4fbcb56b84e6a96801d771f325883', 'request_id': 'req-bb589466-5b76-4f5f-9f9d-b812bb953c99'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:18.302303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf4fbcb56b84e6a96801d771f325883', 'request_id': 'req-bb589466-5b76-4f5f-9f9d-b812bb953c99'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:18.323826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf4fbcb56b84e6a96801d771f325883', 'request_id': 'req-bb589466-5b76-4f5f-9f9d-b812bb953c99'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:18.357997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] The token cache is being invalidate because project dcf4fbcb56b84e6a96801d771f325883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:57:18.358560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:18.359680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bb589466-5b76-4f5f-9f9d-b812bb953c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:57:18.362136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1118/2241] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:57:18 2022] DELETE /identity/v3/projects/dcf4fbcb56b84e6a96801d771f325883 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:18.368783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a595c-df71-4217-bf5a-9de2c0a981f5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:18.369053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a595c-df71-4217-bf5a-9de2c0a981f5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:18.369340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a595c-df71-4217-bf5a-9de2c0a981f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:18.389835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-cb5a595c-df71-4217-bf5a-9de2c0a981f5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:18.392450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cb5a595c-df71-4217-bf5a-9de2c0a981f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:18.515638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1124/2242] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:18.523730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b767f7-7fb7-41c3-958c-587510be40bd None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:18.524012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b767f7-7fb7-41c3-958c-587510be40bd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:18.529955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b767f7-7fb7-41c3-958c-587510be40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:18.583423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-22b767f7-7fb7-41c3-958c-587510be40bd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:18.584775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-22b767f7-7fb7-41c3-958c-587510be40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:18.610958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1119/2243] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:18.614931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a595c-df71-4217-bf5a-9de2c0a981f5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:18.630362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a595c-df71-4217-bf5a-9de2c0a981f5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:18.646068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:18.646900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:18.653010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:18.653534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:18.654565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:57:18.654879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:18.656562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:18.675024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1125/2244] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:57:18.677246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b767f7-7fb7-41c3-958c-587510be40bd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:18.702017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b767f7-7fb7-41c3-958c-587510be40bd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:18.713302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:18.714138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:18.714422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:18.715130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:18.715401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:18.724640 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:18.779291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1120/2245] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:57:18 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:57:18.780643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:18.794930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25bfd3-b36c-46f6-b1d4-056e7881e65a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:18.888686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:18.889695 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:18.890231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:18.890713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:18.891619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:18.893938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:18.927478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1126/2246] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:57:18 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:57:18.931439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:18.947572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2e0b3-d2f1-4077-b4e4-f0d75ab1708b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:18.960923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:18.964674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:18.965267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:18.965747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:18.970132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:18.972172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:19.001405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1121/2247] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:57:19.005248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:19.021544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dda90-19e6-4049-8e05-3e6bed5adec9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:19.035748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510013a-5420-4f39-a838-d4011b98d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:19.036624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510013a-5420-4f39-a838-d4011b98d274 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:19.038569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510013a-5420-4f39-a838-d4011b98d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:19.038889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510013a-5420-4f39-a838-d4011b98d274 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:19.040394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510013a-5420-4f39-a838-d4011b98d274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:19.042108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510013a-5420-4f39-a838-d4011b98d274 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:19.097892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:19.098523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1127/2248] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:57:19.110642 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a19db-167c-4cbb-9eab-70c308eee606 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:19.121499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:19.123261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:19.123778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:19.124223 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] PATH_INFO: `/v3/projects/ba28e6d467154998b4eae495425f12aa/users/6b9b3d707b264422aa36e0d86757ca2e/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:19.194888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba28e6d467154998b4eae495425f12aa, user_id=6b9b3d707b264422aa36e0d86757ca2e, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:19.200172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:19.243101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1122/2249] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:57:19 2022] PUT /identity/v3/projects/ba28e6d467154998b4eae495425f12aa/users/6b9b3d707b264422aa36e0d86757ca2e/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:19.245030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5344-ed34-4e54-b200-89e6d159a961 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:19.245030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5344-ed34-4e54-b200-89e6d159a961 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:19.245312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d5344-ed34-4e54-b200-89e6d159a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:19.275950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-322d5344-ed34-4e54-b200-89e6d159a961 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:19.277469 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-322d5344-ed34-4e54-b200-89e6d159a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:19.363679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1128/2250] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:57:19.375447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:19.378232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:19.455528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78a5e7-dbab-4fb2-8bc4-3af61f110862 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:19.460214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:19.460953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:19.461303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:19.461644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:19.478746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:19.481413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:19.493211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1123/2251] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:57:24.542327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91677-73d8-4552-bebc-2e406b1d19a1 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:24.542889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91677-73d8-4552-bebc-2e406b1d19a1 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:24.542889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91677-73d8-4552-bebc-2e406b1d19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:24.604192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-75b91677-73d8-4552-bebc-2e406b1d19a1 None None] MFA Rules not processed for user `080ad9bb44024051a66e2887c6c3a8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:24.606006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-75b91677-73d8-4552-bebc-2e406b1d19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:24.756064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1129/2252] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:24.767286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:24.768760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:24.969038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e24165-19cc-4838-bab3-8c549107a628 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:24.979835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:24.980986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:24.981508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:24.982048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:24.984506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:25.119429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:25.124871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:25.166429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1124/2253] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:57:26.466835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f954-a94f-408b-9d8a-12d4d1b17f84 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:26.467320 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f954-a94f-408b-9d8a-12d4d1b17f84 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:26.467417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1f954-a94f-408b-9d8a-12d4d1b17f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:26.525147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1bc1f954-a94f-408b-9d8a-12d4d1b17f84 None None] MFA Rules not processed for user `6b9b3d707b264422aa36e0d86757ca2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:26.526702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1bc1f954-a94f-408b-9d8a-12d4d1b17f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:26.617099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1130/2254] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:26.621900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:26.632974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809193-d8ca-4f2d-981d-e29e9b57471c service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:26.639026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:26.639946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:26.640414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:26.640870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:26.641926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:26.645862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:26.692783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1125/2255] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:57:26 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:57:26.694172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1f954-a94f-408b-9d8a-12d4d1b17f84 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:26.714717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1f954-a94f-408b-9d8a-12d4d1b17f84 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:26.795626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:26.796308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:26.796637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:26.796912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:26.797610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:26.800743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:26.827608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1131/2256] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:57:26 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:57:26.831682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:26.845948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63235e8a-399e-483e-bf83-b24c929343e6 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:26.852002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7be2b-05c3-48ee-85dc-88e411c022f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:26.852994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7be2b-05c3-48ee-85dc-88e411c022f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:26.853613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7be2b-05c3-48ee-85dc-88e411c022f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:26.854063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7be2b-05c3-48ee-85dc-88e411c022f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:26.856478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7be2b-05c3-48ee-85dc-88e411c022f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:26.858818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7be2b-05c3-48ee-85dc-88e411c022f0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:26.881408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1126/2257] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:57:26.883193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:26.899550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f74d0b-f979-40c3-8c35-236761a942e9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:26.908528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:26.910206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:26.910687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:26.911182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] PATH_INFO: `/v3/projects/59b13974a2f047b695c7a0b5d56a5348/users/22f0eea35baa47738fb76bb0aa4e805b/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:26.932784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b13974a2f047b695c7a0b5d56a5348, user_id=22f0eea35baa47738fb76bb0aa4e805b, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:26.940039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:26.962407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f6b0-b103-4767-bde2-50f0ce83c68f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:26.962754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f6b0-b103-4767-bde2-50f0ce83c68f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:26.962938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f6b0-b103-4767-bde2-50f0ce83c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:26.967779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1132/2258] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:57:26 2022] PUT /identity/v3/projects/59b13974a2f047b695c7a0b5d56a5348/users/22f0eea35baa47738fb76bb0aa4e805b/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:26.969307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:26.991958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3953f6b0-b103-4767-bde2-50f0ce83c68f None None] MFA Rules not processed for user `676ff129731e4de7ad16b64d52dce9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:26.994025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3953f6b0-b103-4767-bde2-50f0ce83c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:27.093103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1127/2259] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:27.101141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620977b9-973d-4af5-8617-477771e768f9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:27.116333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67391de5-c5e1-47d6-9886-3bf6910163e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:27.117036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67391de5-c5e1-47d6-9886-3bf6910163e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:27.117321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67391de5-c5e1-47d6-9886-3bf6910163e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:27.117596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67391de5-c5e1-47d6-9886-3bf6910163e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:27.119251 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67391de5-c5e1-47d6-9886-3bf6910163e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:27.120892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67391de5-c5e1-47d6-9886-3bf6910163e4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:27.137647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1133/2260] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:57:27.143742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f6b0-b103-4767-bde2-50f0ce83c68f None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:27.168791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f6b0-b103-4767-bde2-50f0ce83c68f None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:27.177304 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbd840-bd63-4667-927c-3d8a13eeed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:27.187346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd840-bd63-4667-927c-3d8a13eeed1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:27.187637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd840-bd63-4667-927c-3d8a13eeed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:27.187916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd840-bd63-4667-927c-3d8a13eeed1f admin admin] PATH_INFO: `/v3/projects/59b13974a2f047b695c7a0b5d56a5348/users/22f0eea35baa47738fb76bb0aa4e805b/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:27.190353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbd840-bd63-4667-927c-3d8a13eeed1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b13974a2f047b695c7a0b5d56a5348, user_id=22f0eea35baa47738fb76bb0aa4e805b, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:27.193183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbd840-bd63-4667-927c-3d8a13eeed1f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:27.224013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1128/2261] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:57:27 2022] PUT /identity/v3/projects/59b13974a2f047b695c7a0b5d56a5348/users/22f0eea35baa47738fb76bb0aa4e805b/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:57:27.913808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:27.914344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:27.914466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:27.935463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] MFA Rules not processed for user `212d3a1984a34761a3b06eff9f26d44f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:27.937666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:28.034295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1134/2262] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:34.692242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9710-7dc3-4bb3-99da-ec525e21c377 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:34.693169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9710-7dc3-4bb3-99da-ec525e21c377 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:34.693505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9710-7dc3-4bb3-99da-ec525e21c377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:34.749915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a6cd9710-7dc3-4bb3-99da-ec525e21c377 None None] MFA Rules not processed for user `22f0eea35baa47738fb76bb0aa4e805b`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:34.751851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a6cd9710-7dc3-4bb3-99da-ec525e21c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:34.894366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1129/2263] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:35.055413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:57:35.057239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:35.164596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6d69c-b104-4ccd-b7af-6fb067d929e2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:57:35.172317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521b04c-c79a-4fbb-84b4-f68ecbb0daba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:57:35.173102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521b04c-c79a-4fbb-84b4-f68ecbb0daba service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:35.173433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521b04c-c79a-4fbb-84b4-f68ecbb0daba service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:35.173714 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521b04c-c79a-4fbb-84b4-f68ecbb0daba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:35.264983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521b04c-c79a-4fbb-84b4-f68ecbb0daba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:57:35.266718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521b04c-c79a-4fbb-84b4-f68ecbb0daba service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:57:35.278207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1135/2264] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:57:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:57:42.273843 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:42.274380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:42.274509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:42.300590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] MFA Rules not processed for user `6bac7b20bdb348c09f0dd59abb7ae08b`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:42.303090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:42.407479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1130/2265] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:57:55.998157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d573-e777-4308-a09b-f35777ffee76 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:57:55.998778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d573-e777-4308-a09b-f35777ffee76 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:57:55.998778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d573-e777-4308-a09b-f35777ffee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:57:56.015600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-79f5d573-e777-4308-a09b-f35777ffee76 None None] MFA Rules not processed for user `6b9b3d707b264422aa36e0d86757ca2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:57:56.016788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-79f5d573-e777-4308-a09b-f35777ffee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:57:56.024732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1136/2266] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:03.326166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:03.327566 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:03.385663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18853a2-c88f-4924-b859-a321aff0dc2d None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:03.389336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:03.389982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:03.390300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:03.390580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:03.452485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:03.453982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:03.464211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1131/2267] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:11.624326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5d573-e777-4308-a09b-f35777ffee76 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:11.634152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5d573-e777-4308-a09b-f35777ffee76 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:11.637818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:11.638486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:11.638761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:11.639030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:11.641019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:11.655208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:11.656642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:11.667568 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1137/2268] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:11.903696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:11.912667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46dd90-db62-4033-8227-ebbf0e9aa923 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:11.916715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:11.917349 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:11.917639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:11.917907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:11.919993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:11.933525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:11.934967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:11.945999 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1132/2269] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:14.335141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:14.344233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26249d02-a485-439e-8b7c-7e6c1e636973 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:14.348709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:14.349355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:14.349640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:14.349917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:14.360039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:14.361479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:14.371588 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1138/2270] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:16.682045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:16.690747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45bb05-0e20-4875-84ea-8b681e05445e service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:16.694638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:16.695282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:16.695564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:16.695837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:16.697688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:16.762633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:16.764072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:16.775928 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1133/2271] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:20.240344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:20.242452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:20.258331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf9c03-75bc-4946-9a02-7d191390eac8 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:20.263394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:20.264277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:20.264592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:20.264970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] PATH_INFO: `/v3/users/4f558c4579064393afc9d5cb58eacdd2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:20.266565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f558c4579064393afc9d5cb58eacdd2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:20.268936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:20.316615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f558c4579064393afc9d5cb58eacdd2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.328574 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f558c4579064393afc9d5cb58eacdd2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.335998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f558c4579064393afc9d5cb58eacdd2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.344111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f558c4579064393afc9d5cb58eacdd2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.344755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ea9f39e8-0f08-4895-ba82-00561e66864f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f558c4579064393afc9d5cb58eacdd2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.350978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1139/2272] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:58:20 2022] DELETE /identity/v3/users/4f558c4579064393afc9d5cb58eacdd2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:20.522563 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:20.532456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efec793-8f28-46ec-ba0c-fec60a7af7b3 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:20.590535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:20.591428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:20.591708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:20.591982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] PATH_INFO: `/v3/projects/48695dad755f431289080f28ffc6f0d8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:20.593227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=48695dad755f431289080f28ffc6f0d8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:20.595317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:20.643633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48695dad755f431289080f28ffc6f0d8', 'request_id': 'req-9d9a9b99-2e28-49fc-94c5-9112839bf3da'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.652556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48695dad755f431289080f28ffc6f0d8', 'request_id': 'req-9d9a9b99-2e28-49fc-94c5-9112839bf3da'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.659728 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48695dad755f431289080f28ffc6f0d8', 'request_id': 'req-9d9a9b99-2e28-49fc-94c5-9112839bf3da'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.671423 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] The token cache is being invalidate because project 48695dad755f431289080f28ffc6f0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:58:20.671770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.672393 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-9d9a9b99-2e28-49fc-94c5-9112839bf3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:20.674067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1134/2273] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:58:20 2022] DELETE /identity/v3/projects/48695dad755f431289080f28ffc6f0d8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:20.679149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31333-a169-4b64-85d9-0fb515bcedc3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:20.679452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31333-a169-4b64-85d9-0fb515bcedc3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:20.679741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31333-a169-4b64-85d9-0fb515bcedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:20.697817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-eeb31333-a169-4b64-85d9-0fb515bcedc3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:20.698977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-eeb31333-a169-4b64-85d9-0fb515bcedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:20.757644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1140/2274] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:20.765915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c60d06-00ee-420e-bb71-b04e2d0122a5 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:20.766235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c60d06-00ee-420e-bb71-b04e2d0122a5 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:20.766510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c60d06-00ee-420e-bb71-b04e2d0122a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:20.785822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-16c60d06-00ee-420e-bb71-b04e2d0122a5 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:20.787064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-16c60d06-00ee-420e-bb71-b04e2d0122a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:20.796307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1135/2275] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:20.800647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb31333-a169-4b64-85d9-0fb515bcedc3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:20.810678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb31333-a169-4b64-85d9-0fb515bcedc3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:20.816029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:20.816700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:20.816981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:20.817252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:20.817992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:58:20.818331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:20.819943 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:20.832569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1141/2276] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:58:20.837138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c60d06-00ee-420e-bb71-b04e2d0122a5 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:20.846934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c60d06-00ee-420e-bb71-b04e2d0122a5 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:20.852998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:20.853645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:20.853933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:20.854235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:20.854935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:20.856819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:20.887635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1136/2277] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:58:20 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:20.892247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:20.902765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef084-0712-4eed-a726-3da8789f0a6b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:20.960619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:20.961207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:20.961493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:20.961770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:20.962515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:20.964475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:20.986093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1142/2278] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:58:20 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:20.990331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.000515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc407b2c-2a19-41b3-8cb2-df9901ba00f2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.005625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.006319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.006627 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.006908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.007647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.009276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.019528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1137/2279] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:21.023310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.033213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b72b-8c6e-4320-b8f9-489d028e54e7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.038688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51a788-3512-4b12-a991-7199867e33d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.039334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51a788-3512-4b12-a991-7199867e33d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.039618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51a788-3512-4b12-a991-7199867e33d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.039893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51a788-3512-4b12-a991-7199867e33d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.040620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51a788-3512-4b12-a991-7199867e33d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.042241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51a788-3512-4b12-a991-7199867e33d1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.051890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1143/2280] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:21.055881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.065775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17c55-6c8a-4a7c-936f-375ae99355d8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.070918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.071793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.072079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.072354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] PATH_INFO: `/v3/projects/273b0849a7c1440da05204f2768dc772/users/85df762291f249b0bc6fc92f8277d001/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.087844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273b0849a7c1440da05204f2768dc772, user_id=85df762291f249b0bc6fc92f8277d001, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.090636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.105277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1138/2281] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:21 2022] PUT /identity/v3/projects/273b0849a7c1440da05204f2768dc772/users/85df762291f249b0bc6fc92f8277d001/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:21.115413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641530e-1ba2-4a0e-bfc6-63c3a1fc9be5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.115704 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641530e-1ba2-4a0e-bfc6-63c3a1fc9be5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.116033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641530e-1ba2-4a0e-bfc6-63c3a1fc9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.142287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5641530e-1ba2-4a0e-bfc6-63c3a1fc9be5 None None] MFA Rules not processed for user `85df762291f249b0bc6fc92f8277d001`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:21.143465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5641530e-1ba2-4a0e-bfc6-63c3a1fc9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:21.211552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1144/2282] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:58:21.216143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.275336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32d1d5-edeb-4889-9875-d41f74533e23 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.283606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.284620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.285051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.285397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.286506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.289733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.320211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1139/2283] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:58:21 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:21.324427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641530e-1ba2-4a0e-bfc6-63c3a1fc9be5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.336333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641530e-1ba2-4a0e-bfc6-63c3a1fc9be5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.396974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.397680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.397963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.398266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.398975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.400900 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.422792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1145/2284] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:58:21 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:21.426976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.437534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e3889-4b3d-42df-87ce-dafb887e2882 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.443212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.443879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.444157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.444430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.445160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.446819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.458008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1140/2285] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:21.462314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.472512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d526bb8-c2ea-41a5-9024-e1a653d8e8dc admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.477601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.478546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.478794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.479068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] PATH_INFO: `/v3/projects/6bf6344dfb1c480ea987214329238a2f/users/9d460b6139e240728d7102f2381a6ba3/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.493990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf6344dfb1c480ea987214329238a2f, user_id=9d460b6139e240728d7102f2381a6ba3, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.496693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.512419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1146/2286] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:21 2022] PUT /identity/v3/projects/6bf6344dfb1c480ea987214329238a2f/users/9d460b6139e240728d7102f2381a6ba3/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:58:21.517855 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.528381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b9ac-0c1b-47ff-8f99-e50ae591d599 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.586920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae76a5-e0b2-4be4-b2bf-fedd3dd496cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.587595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae76a5-e0b2-4be4-b2bf-fedd3dd496cc admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.587875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae76a5-e0b2-4be4-b2bf-fedd3dd496cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.588149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae76a5-e0b2-4be4-b2bf-fedd3dd496cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.588888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae76a5-e0b2-4be4-b2bf-fedd3dd496cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.590530 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae76a5-e0b2-4be4-b2bf-fedd3dd496cc admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.600725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1141/2287] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:21.605121 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.616017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773bd36-6c3f-4f9c-b410-f3aa3f71da6b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.621729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.622651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.622937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.623213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] PATH_INFO: `/v3/projects/6bf6344dfb1c480ea987214329238a2f/users/9d460b6139e240728d7102f2381a6ba3/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.625398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf6344dfb1c480ea987214329238a2f, user_id=9d460b6139e240728d7102f2381a6ba3, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.628063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.638712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1147/2288] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:21 2022] PUT /identity/v3/projects/6bf6344dfb1c480ea987214329238a2f/users/9d460b6139e240728d7102f2381a6ba3/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:21.649948 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aea3d-563f-4259-827b-f6bd712ef024 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.650266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aea3d-563f-4259-827b-f6bd712ef024 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.650548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aea3d-563f-4259-827b-f6bd712ef024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.677963 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-838aea3d-563f-4259-827b-f6bd712ef024 None None] MFA Rules not processed for user `9d460b6139e240728d7102f2381a6ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:21.679212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-838aea3d-563f-4259-827b-f6bd712ef024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:21.747651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1142/2289] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:21.758918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:21.761027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:21.844017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806b93-4c50-4264-b235-530cd56b6070 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:21.848050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7277cd-143f-4789-b469-bb1b08389e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:21.848683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7277cd-143f-4789-b469-bb1b08389e61 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:21.848973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7277cd-143f-4789-b469-bb1b08389e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:21.849243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7277cd-143f-4789-b469-bb1b08389e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:21.859063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7277cd-143f-4789-b469-bb1b08389e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:21.860683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7277cd-143f-4789-b469-bb1b08389e61 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:21.870427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1148/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:22.314656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aea3d-563f-4259-827b-f6bd712ef024 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:22.377947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838aea3d-563f-4259-827b-f6bd712ef024 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:22.382990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:22.383899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:22.384201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:22.384447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] PATH_INFO: `/v3/users/85df762291f249b0bc6fc92f8277d001` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:22.385666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85df762291f249b0bc6fc92f8277d001)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:22.387634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:22.436830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85df762291f249b0bc6fc92f8277d001'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:22.443485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85df762291f249b0bc6fc92f8277d001'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:22.444133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85df762291f249b0bc6fc92f8277d001'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:22.444730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85df762291f249b0bc6fc92f8277d001'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:22.456163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85df762291f249b0bc6fc92f8277d001'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:22.470356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1143/2291] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:58:22 2022] DELETE /identity/v3/users/85df762291f249b0bc6fc92f8277d001 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:22.474917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:22.475404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:22.475514 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:22.495799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:22.497616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:22.559907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1149/2292] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:22.569630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:22.571144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:22.632112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bb39c-edc1-4105-bcd1-0a21e209d314 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:22.636587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:22.637242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:22.637501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:22.637779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:22.647868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:22.649307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:22.658985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1144/2293] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:22.935913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:22.937571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:22.950225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b68b1-fb65-40de-9243-ba5f8b02d593 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:22.956451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:22.957381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:22.957580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:22.957844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] PATH_INFO: `/v3/projects/273b0849a7c1440da05204f2768dc772` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:22.959189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273b0849a7c1440da05204f2768dc772)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:22.961093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:23.009516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273b0849a7c1440da05204f2768dc772', 'request_id': 'req-4eb31052-c7b8-4f42-8800-52c77a38f3a7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.017862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273b0849a7c1440da05204f2768dc772', 'request_id': 'req-4eb31052-c7b8-4f42-8800-52c77a38f3a7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.023905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273b0849a7c1440da05204f2768dc772', 'request_id': 'req-4eb31052-c7b8-4f42-8800-52c77a38f3a7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.035173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] The token cache is being invalidate because project 273b0849a7c1440da05204f2768dc772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:58:23.035460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.036196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.037940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1150/2294] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:58:22 2022] DELETE /identity/v3/projects/273b0849a7c1440da05204f2768dc772 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:23.043325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:23.053001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7dd6f-84f0-4449-b188-17dba198b351 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:23.107814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:23.108664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.108946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.109225 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] PATH_INFO: `/v3/users/9d460b6139e240728d7102f2381a6ba3` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.110449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d460b6139e240728d7102f2381a6ba3)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:23.112434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:23.168511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d460b6139e240728d7102f2381a6ba3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.178483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d460b6139e240728d7102f2381a6ba3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.179270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d460b6139e240728d7102f2381a6ba3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.179987 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d460b6139e240728d7102f2381a6ba3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.193468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-ffca427b-56b2-46cb-ab4a-29059f1c33b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d460b6139e240728d7102f2381a6ba3'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.214800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1145/2295] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:58:23 2022] DELETE /identity/v3/users/9d460b6139e240728d7102f2381a6ba3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:58:23.487938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:23.489428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:23.502920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb31052-c7b8-4f42-8800-52c77a38f3a7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:23.559104 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:23.559980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.560262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.560537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] PATH_INFO: `/v3/projects/6bf6344dfb1c480ea987214329238a2f` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.561761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf6344dfb1c480ea987214329238a2f)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:23.563885 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:23.613385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf6344dfb1c480ea987214329238a2f', 'request_id': 'req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.622957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf6344dfb1c480ea987214329238a2f', 'request_id': 'req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.630584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf6344dfb1c480ea987214329238a2f', 'request_id': 'req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.641049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] The token cache is being invalidate because project 6bf6344dfb1c480ea987214329238a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:58:23.641333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.642062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3ac3c412-3955-40ab-8866-9ebcb5eddfdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:23.643662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1151/2296] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:58:23 2022] DELETE /identity/v3/projects/6bf6344dfb1c480ea987214329238a2f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:23.649443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8a0f-73d8-40ff-a391-7a541231d450 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.649957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8a0f-73d8-40ff-a391-7a541231d450 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.649957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e8a0f-73d8-40ff-a391-7a541231d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.668128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2b9e8a0f-73d8-40ff-a391-7a541231d450 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:23.669316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2b9e8a0f-73d8-40ff-a391-7a541231d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:23.733462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1146/2297] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 14:58:23.741989 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9cb5-200e-46bf-b1d2-9493985c031b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.742309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9cb5-200e-46bf-b1d2-9493985c031b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.742590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9cb5-200e-46bf-b1d2-9493985c031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.766758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d22c9cb5-200e-46bf-b1d2-9493985c031b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:23.768031 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d22c9cb5-200e-46bf-b1d2-9493985c031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:23.777744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1152/2298] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:23.782287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8a0f-73d8-40ff-a391-7a541231d450 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:23.792426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e8a0f-73d8-40ff-a391-7a541231d450 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:23.798581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:23.799236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.799653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.799940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.800679 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:58:23.800992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:23.802627 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:23.814966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1147/2299] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:58:23.819860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9cb5-200e-46bf-b1d2-9493985c031b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:23.832840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9cb5-200e-46bf-b1d2-9493985c031b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:23.838765 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:23.839423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.839706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.839975 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.840660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:23.842599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:23.874833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1153/2300] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:58:23 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:23.880390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:23.890664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b83095-6952-4305-9531-4638b876a38f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:23.947641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:23.948317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.948602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.948880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.949580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:23.951533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:23.974203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1148/2301] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:58:23 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:23.979621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:23.990725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1326d0-d997-4ee5-9b68-3764364480b8 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:23.996386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:23.997279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:23.997678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:23.998040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:23.999047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:24.000719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:24.011674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1154/2302] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:24.015743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:24.025892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87f7e-4e1f-48b6-801c-d0a2d5db3a48 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:24.031371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8e457-0461-49c2-a58c-8f40aa9b25de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:24.032019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e457-0461-49c2-a58c-8f40aa9b25de admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:24.032310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e457-0461-49c2-a58c-8f40aa9b25de admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:24.032623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e457-0461-49c2-a58c-8f40aa9b25de admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:24.033380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8e457-0461-49c2-a58c-8f40aa9b25de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:24.034994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8e457-0461-49c2-a58c-8f40aa9b25de admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:24.045309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1149/2303] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:24.049844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:24.060099 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779be61-59f8-4e06-b5e9-706ea2c4e0bd admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:24.065461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:24.066382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:24.066685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:24.066959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] PATH_INFO: `/v3/projects/6bb37b6191384b6da94c34720a01c917/users/b5ca7030827d48b38f9422b110e4b9c9/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:24.082392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb37b6191384b6da94c34720a01c917, user_id=b5ca7030827d48b38f9422b110e4b9c9, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:24.085023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:24.101878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1155/2304] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:24 2022] PUT /identity/v3/projects/6bb37b6191384b6da94c34720a01c917/users/b5ca7030827d48b38f9422b110e4b9c9/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:24.112541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:24.112839 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:24.113120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:24.140823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] MFA Rules not processed for user `b5ca7030827d48b38f9422b110e4b9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:24.142010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:24.209028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1150/2305] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:24.220430 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:24.222608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:24.308124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dfba1-a870-44f6-8773-02609a2b4a01 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:24.318338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d00dd5-dcec-401d-b811-8452ed12f305 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:24.319003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00dd5-dcec-401d-b811-8452ed12f305 service glance] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:24.319280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00dd5-dcec-401d-b811-8452ed12f305 service glance] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:24.319547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00dd5-dcec-401d-b811-8452ed12f305 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:24.328878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d00dd5-dcec-401d-b811-8452ed12f305 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:24.330690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d00dd5-dcec-401d-b811-8452ed12f305 service glance] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:24.339429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1156/2306] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:28.764064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:28.765721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:28.848103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef9174-d7fb-4411-b941-e484248ac7c1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:28.854114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:28.854764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:28.855135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:28.855413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:28.857357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:28.928842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:28.930486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:28.940903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1151/2307] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:33.447457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:33.448009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:33.448009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:33.467167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] MFA Rules not processed for user `011fa6cf9d534cd2a7e3d80326eec76f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:33.468673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:33.533038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1157/2308] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:34.171645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:34.173242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:34.247408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ee104-2768-4d71-8bfa-664727a8549a service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:34.251811 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca33f2f8bb0a4631912f0ed51c6f8c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:34.252582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:34.252871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:34.253227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:34.254941 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:34.266490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:34.268125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:34.278171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1152/2309] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:36.141037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:36.142637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:36.207091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934db4-d13b-4687-9204-0b418c0d2f4d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:36.210833 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:36.211489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:36.211775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:36.212741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:36.214883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:36.225354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:36.227174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:36.241755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1158/2310] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:37.531135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:37.543899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e83790-cc04-4ef3-be69-f55e5efa8abe service placement] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:37.550358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:37.551001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:37.551285 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:37.551562 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:37.553345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:37.565165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:37.566779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:37.575903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1153/2311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:43.126648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:43.141312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86015d20-1093-4368-b990-dbb3465e9762 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:43.147145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602511fb-a6d7-4374-bbe2-c4c6dba6946d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:43.147798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602511fb-a6d7-4374-bbe2-c4c6dba6946d service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:43.148106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602511fb-a6d7-4374-bbe2-c4c6dba6946d service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:43.148384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602511fb-a6d7-4374-bbe2-c4c6dba6946d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:43.150319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-602511fb-a6d7-4374-bbe2-c4c6dba6946d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:43.163780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602511fb-a6d7-4374-bbe2-c4c6dba6946d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:43.165675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602511fb-a6d7-4374-bbe2-c4c6dba6946d service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:43.178482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1159/2312] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:44.166748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:44.232346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c54a60-fe36-4c87-ab16-6b467c11645b service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:44.243065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:44.243969 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:44.244256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:44.244580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] PATH_INFO: `/v3/users/b5ca7030827d48b38f9422b110e4b9c9` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:44.245817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ca7030827d48b38f9422b110e4b9c9)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:44.247799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:44.299195 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ca7030827d48b38f9422b110e4b9c9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:44.307715 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ca7030827d48b38f9422b110e4b9c9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:44.308746 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ca7030827d48b38f9422b110e4b9c9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:44.309581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ca7030827d48b38f9422b110e4b9c9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:44.324202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ca7030827d48b38f9422b110e4b9c9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:44.339394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1154/2313] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:58:44 2022] DELETE /identity/v3/users/b5ca7030827d48b38f9422b110e4b9c9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:58:44.344248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:44.344826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:44.344928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:44.361444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:44.362681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:44.422714 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1160/2314] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:44.433015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:44.435151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:44.496176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba3dfb-1095-478a-9525-a9c4bdb07511 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:44.500537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:44.501236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:44.501517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:44.501798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:44.511522 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:44.512935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:44.523109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1155/2315] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:44.730760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:44.733429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:44.819208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc17e0-73c0-4a1b-b91a-69fd2e65ce7f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:44.825604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef683f-ad25-40d0-b6bb-7408e7dd7cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:44.826590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef683f-ad25-40d0-b6bb-7408e7dd7cad service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:44.827029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef683f-ad25-40d0-b6bb-7408e7dd7cad service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:44.827570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef683f-ad25-40d0-b6bb-7408e7dd7cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:44.830452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a3ef683f-ad25-40d0-b6bb-7408e7dd7cad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:44.914718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef683f-ad25-40d0-b6bb-7408e7dd7cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:44.916344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef683f-ad25-40d0-b6bb-7408e7dd7cad service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:44.929571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1161/2316] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:45.205660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:45.207290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:45.274971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523265fd-d46c-4739-84d0-22d6836115dc service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:45.281502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:45.282655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.282960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.283239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] PATH_INFO: `/v3/projects/6bb37b6191384b6da94c34720a01c917` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.285399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb37b6191384b6da94c34720a01c917)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:45.287440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:45.341169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb37b6191384b6da94c34720a01c917', 'request_id': 'req-236935ac-63c6-4dba-8427-f1d8cf892308'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:45.350268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb37b6191384b6da94c34720a01c917', 'request_id': 'req-236935ac-63c6-4dba-8427-f1d8cf892308'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:45.356968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb37b6191384b6da94c34720a01c917', 'request_id': 'req-236935ac-63c6-4dba-8427-f1d8cf892308'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:45.372196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] The token cache is being invalidate because project 6bb37b6191384b6da94c34720a01c917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:58:45.372587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:45.373282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-236935ac-63c6-4dba-8427-f1d8cf892308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:45.375026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1156/2317] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:58:45 2022] DELETE /identity/v3/projects/6bb37b6191384b6da94c34720a01c917 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:45.380381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54237-f77b-4d82-9090-ff95d696cbd3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.381196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54237-f77b-4d82-9090-ff95d696cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.381478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54237-f77b-4d82-9090-ff95d696cbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.402372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-31d54237-f77b-4d82-9090-ff95d696cbd3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:45.403708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-31d54237-f77b-4d82-9090-ff95d696cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:45.462545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1162/2318] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:45.471590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2e4b-a045-41b0-ac3c-860ad01a4696 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.471881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2e4b-a045-41b0-ac3c-860ad01a4696 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.472156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc2e4b-a045-41b0-ac3c-860ad01a4696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.490441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a9dc2e4b-a045-41b0-ac3c-860ad01a4696 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:45.491625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a9dc2e4b-a045-41b0-ac3c-860ad01a4696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:45.500777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1157/2319] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:45.505272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d54237-f77b-4d82-9090-ff95d696cbd3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:45.514930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d54237-f77b-4d82-9090-ff95d696cbd3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:45.519652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:45.520312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.520598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.520873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.521602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:58:45.521908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:45.523538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:45.536661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1163/2320] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:58:45.540980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc2e4b-a045-41b0-ac3c-860ad01a4696 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:45.550065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc2e4b-a045-41b0-ac3c-860ad01a4696 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:45.555017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:45.555675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.556032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.556326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.557053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:45.559242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:45.585336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1158/2321] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:58:45 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:45.589857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:45.600649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3323ae-bcbf-4fdf-afb1-9bdd2ca6232f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:45.661580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:45.662323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.662723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.662861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.666637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:45.668591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:45.691512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1164/2322] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:58:45 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:45.696404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:45.707837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b1d5-cbc4-427e-bac2-796ac909c601 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:45.713352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:45.713962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.714278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.714554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.715321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:45.716920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:45.727896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1159/2323] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:58:45.732064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:45.742758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc23ea-0e32-4015-aa60-83386b712c58 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:45.748215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02986b63-6aa7-422b-a6cf-9d9f891e2031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:45.748959 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986b63-6aa7-422b-a6cf-9d9f891e2031 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.749245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986b63-6aa7-422b-a6cf-9d9f891e2031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.749521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02986b63-6aa7-422b-a6cf-9d9f891e2031 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.750342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02986b63-6aa7-422b-a6cf-9d9f891e2031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:45.752357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02986b63-6aa7-422b-a6cf-9d9f891e2031 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:45.763495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1165/2324] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:45.767903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:45.777844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca9b0b-83dc-4379-856f-df1dfcb3b2f4 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:45.782900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:45.783876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.784163 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.784431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] PATH_INFO: `/v3/projects/1600d594b7e34f2ab2a63d38f671dd05/users/b5454c0e02384f26a1173e901b3fd2a8/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.801268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1600d594b7e34f2ab2a63d38f671dd05, user_id=b5454c0e02384f26a1173e901b3fd2a8, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:45.804104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:45.818686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1160/2325] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:45 2022] PUT /identity/v3/projects/1600d594b7e34f2ab2a63d38f671dd05/users/b5454c0e02384f26a1173e901b3fd2a8/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:58:45.831141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0c70-ae0d-4953-8777-37b928508098 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:45.831704 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0c70-ae0d-4953-8777-37b928508098 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:45.832086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0c70-ae0d-4953-8777-37b928508098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:45.860174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-071f0c70-ae0d-4953-8777-37b928508098 None None] MFA Rules not processed for user `b5454c0e02384f26a1173e901b3fd2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:45.861387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-071f0c70-ae0d-4953-8777-37b928508098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:45.938666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1166/2326] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:45.943277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.005214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d4be-bd84-47ad-839d-2846b41a7302 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.010244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.010918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.011206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.011489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.012196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.014116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.040593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1161/2327] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:58:45 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:46.044696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0c70-ae0d-4953-8777-37b928508098 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.055941 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0c70-ae0d-4953-8777-37b928508098 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.111879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.112558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.112837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.113134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.113926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.115936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.137201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1167/2328] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:58:46 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 14:58:46.141276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.152704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79102-d201-4b20-98cf-c55fa2220965 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.158396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.159040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.159326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.159658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.160376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.161938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.173305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1162/2329] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:58:46.177609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.190356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41241480-d2e4-44f4-a440-2e49afacd69b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.195319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f541e92-a960-4c12-92cb-d918baf47328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.196014 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f541e92-a960-4c12-92cb-d918baf47328 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.196304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f541e92-a960-4c12-92cb-d918baf47328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.196584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f541e92-a960-4c12-92cb-d918baf47328 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.197352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f541e92-a960-4c12-92cb-d918baf47328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.199003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f541e92-a960-4c12-92cb-d918baf47328 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.209812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1168/2330] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:46.214005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.224503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745411-e663-4b7c-8b82-8b15423dd100 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.230000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.231171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.231704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.232142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] PATH_INFO: `/v3/projects/4586cce44ea14b539e150a86031ded01/users/b0309f9e308f498dac92ccf061a5e702/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.249748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4586cce44ea14b539e150a86031ded01, user_id=b0309f9e308f498dac92ccf061a5e702, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.252472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.269031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1163/2331] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:46 2022] PUT /identity/v3/projects/4586cce44ea14b539e150a86031ded01/users/b0309f9e308f498dac92ccf061a5e702/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:46.279301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4564-b23f-470e-828c-767551139e9c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.279591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4564-b23f-470e-828c-767551139e9c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.279866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4564-b23f-470e-828c-767551139e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.314530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ba4f4564-b23f-470e-828c-767551139e9c None None] MFA Rules not processed for user `b0309f9e308f498dac92ccf061a5e702`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:46.315845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ba4f4564-b23f-470e-828c-767551139e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:46.386382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1169/2332] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:46.392483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.468171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e99bd-64e7-4ccf-9f90-8bafcdb86fcf admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.473504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.474431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.474888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.475343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.476495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.479706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.513320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1164/2333] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:58:46 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:58:46.514447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f4564-b23f-470e-828c-767551139e9c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.525061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f4564-b23f-470e-828c-767551139e9c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.583007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.583795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.584143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.584479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.585374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.587393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.610456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1170/2334] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:58:46 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:58:46.614283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.624368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a15a90-a12f-4c13-a93c-39a99926c847 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.629242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.630105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.630366 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.630682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.631516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.633396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.644377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1165/2335] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:46.648637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.658545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5522785-dda5-49cb-ab7e-f89c93f0be52 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.663322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.664207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.664477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.664768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] PATH_INFO: `/v3/projects/2cbab03e6eed44d29e73d9b21dca0711/users/f7ed79c2218b4f89ad6a022aa591b066/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.679150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbab03e6eed44d29e73d9b21dca0711, user_id=f7ed79c2218b4f89ad6a022aa591b066, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.681779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.696538 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1171/2336] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:46 2022] PUT /identity/v3/projects/2cbab03e6eed44d29e73d9b21dca0711/users/f7ed79c2218b4f89ad6a022aa591b066/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:46.700165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.710768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144cc30-2057-4c83-bd1b-61ae6cbb9aa2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.767018 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7c9c-8c43-4bc0-95ff-dd0217f8ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.767587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7c9c-8c43-4bc0-95ff-dd0217f8ce81 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.767870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7c9c-8c43-4bc0-95ff-dd0217f8ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.768141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7c9c-8c43-4bc0-95ff-dd0217f8ce81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.768866 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7c9c-8c43-4bc0-95ff-dd0217f8ce81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.770486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7c9c-8c43-4bc0-95ff-dd0217f8ce81 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.780276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1166/2337] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 14:58:46.784672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.795293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3844c-16e9-4966-aa86-197da4b0f031 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:46.801455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:46.802480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.802837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.803132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] PATH_INFO: `/v3/projects/2cbab03e6eed44d29e73d9b21dca0711/users/f7ed79c2218b4f89ad6a022aa591b066/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.805252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbab03e6eed44d29e73d9b21dca0711, user_id=f7ed79c2218b4f89ad6a022aa591b066, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:46.807934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:46.818596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1172/2338] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:46 2022] PUT /identity/v3/projects/2cbab03e6eed44d29e73d9b21dca0711/users/f7ed79c2218b4f89ad6a022aa591b066/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:58:46.830169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c86d6-004d-4e9b-98dd-0d7ea9eed732 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:46.830467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c86d6-004d-4e9b-98dd-0d7ea9eed732 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:46.830730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c86d6-004d-4e9b-98dd-0d7ea9eed732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:46.857622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-043c86d6-004d-4e9b-98dd-0d7ea9eed732 None None] MFA Rules not processed for user `f7ed79c2218b4f89ad6a022aa591b066`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:46.859006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-043c86d6-004d-4e9b-98dd-0d7ea9eed732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:46.933613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1167/2339] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:46.945751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:46.947505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:47.008204 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b146-f3bf-465b-bee0-20f2bf5c3316 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:47.012062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:47.012712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:47.013117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:47.013398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:47.070990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:47.072428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:47.081762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1173/2340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:47.251920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:47.252914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:47.253424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:47.276898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] MFA Rules not processed for user `212d3a1984a34761a3b06eff9f26d44f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:47.278850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:47.346585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1168/2341] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:47.894285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:47.908563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:47.977849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e606df9-6688-4ae2-bdc1-b8acc1f15531 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:47.981836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:47.982618 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:47.982963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:47.983300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:47.985285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:47.996012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:47.997933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:48.007615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1174/2342] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:48.743352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:48.745670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:48.764609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6905d-3b44-4573-aa97-0caa9efa07df None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:48.768468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:48.769122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:48.769408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:48.769684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:48.838234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:48.839745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:48.849357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1169/2343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:49.484321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:49.494196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb1813-3303-4ee3-9d8f-d3dc94685148 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:49.498381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998711c5-ad24-43c4-aa29-8fcbc18d0fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:49.499024 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998711c5-ad24-43c4-aa29-8fcbc18d0fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:49.499344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998711c5-ad24-43c4-aa29-8fcbc18d0fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:49.499609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998711c5-ad24-43c4-aa29-8fcbc18d0fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:49.509156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998711c5-ad24-43c4-aa29-8fcbc18d0fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:49.510622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998711c5-ad24-43c4-aa29-8fcbc18d0fc4 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:49.520451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1175/2344] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:53.403742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:53.477218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b6d39-6a27-4417-b4d0-4e1e1ff5f02d service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:53.483326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:53.484201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:53.484483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:53.484756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] PATH_INFO: `/v3/users/b5454c0e02384f26a1173e901b3fd2a8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:53.486130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5454c0e02384f26a1173e901b3fd2a8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:53.488086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:53.544475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5454c0e02384f26a1173e901b3fd2a8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:53.552277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5454c0e02384f26a1173e901b3fd2a8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:53.552991 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5454c0e02384f26a1173e901b3fd2a8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:53.553663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5454c0e02384f26a1173e901b3fd2a8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:53.565283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5454c0e02384f26a1173e901b3fd2a8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:53.579709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1170/2345] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:58:53 2022] DELETE /identity/v3/users/b5454c0e02384f26a1173e901b3fd2a8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:53.584264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:53.584754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:53.584905 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:53.602509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:53.603682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:53.676648 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1176/2346] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:53.686754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:53.688435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:53.745209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6d14-65ea-4892-a154-91ea31be9f0d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:53.749106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:53.749749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:53.750027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:53.750333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:53.759711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:53.761135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:53.770744 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1171/2347] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:54.286401 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:54.287953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:54.299770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9b38d-6fcd-40fd-893a-a05d4b6d5695 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:54.305094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:54.306214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:54.306497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:54.306767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] PATH_INFO: `/v3/projects/1600d594b7e34f2ab2a63d38f671dd05` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:54.307963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1600d594b7e34f2ab2a63d38f671dd05)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:54.309890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:54.356363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1600d594b7e34f2ab2a63d38f671dd05', 'request_id': 'req-d39da59d-27f8-408c-a0ad-733e98d61b09'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.367408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1600d594b7e34f2ab2a63d38f671dd05', 'request_id': 'req-d39da59d-27f8-408c-a0ad-733e98d61b09'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.372920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1600d594b7e34f2ab2a63d38f671dd05', 'request_id': 'req-d39da59d-27f8-408c-a0ad-733e98d61b09'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.384646 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] The token cache is being invalidate because project 1600d594b7e34f2ab2a63d38f671dd05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:58:54.384873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.385592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.387389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1177/2348] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:58:54 2022] DELETE /identity/v3/projects/1600d594b7e34f2ab2a63d38f671dd05 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:54.391576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:54.401302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4916a2-d173-4d1f-a41f-5b20920bd4b1 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:54.458474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:54.459512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:54.459915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:54.460278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] PATH_INFO: `/v3/users/b0309f9e308f498dac92ccf061a5e702` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:54.461629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0309f9e308f498dac92ccf061a5e702)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:54.463780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:54.511551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0309f9e308f498dac92ccf061a5e702'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.521623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0309f9e308f498dac92ccf061a5e702'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.522634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0309f9e308f498dac92ccf061a5e702'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.523544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0309f9e308f498dac92ccf061a5e702'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.537847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0309f9e308f498dac92ccf061a5e702'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.553506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1172/2349] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:58:54 2022] DELETE /identity/v3/users/b0309f9e308f498dac92ccf061a5e702 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 14:58:54.827402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:54.828955 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:54.844600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39da59d-27f8-408c-a0ad-733e98d61b09 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:54.900957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:54.901760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:54.902036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:54.902336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] PATH_INFO: `/v3/projects/4586cce44ea14b539e150a86031ded01` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:54.903546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4586cce44ea14b539e150a86031ded01)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:54.905705 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:54.951751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4586cce44ea14b539e150a86031ded01', 'request_id': 'req-e8687042-4a4b-4229-9836-39e0f10d6ec2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.962684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4586cce44ea14b539e150a86031ded01', 'request_id': 'req-e8687042-4a4b-4229-9836-39e0f10d6ec2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.971507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4586cce44ea14b539e150a86031ded01', 'request_id': 'req-e8687042-4a4b-4229-9836-39e0f10d6ec2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.983356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] The token cache is being invalidate because project 4586cce44ea14b539e150a86031ded01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:58:54.983644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.984374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:54.986456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1178/2350] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:58:54 2022] DELETE /identity/v3/projects/4586cce44ea14b539e150a86031ded01 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:54.990742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:54.992286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:55.005169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07cab-6a72-4b5a-849e-9be29fc943c4 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.067956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.068860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.069138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.069436 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] PATH_INFO: `/v3/users/f7ed79c2218b4f89ad6a022aa591b066` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.070852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ed79c2218b4f89ad6a022aa591b066)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:55.072771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:55.122142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ed79c2218b4f89ad6a022aa591b066'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.128931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ed79c2218b4f89ad6a022aa591b066'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.129711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ed79c2218b4f89ad6a022aa591b066'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.130459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ed79c2218b4f89ad6a022aa591b066'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.143183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-5a73a48d-a168-447c-8180-a1edc9ba4e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ed79c2218b4f89ad6a022aa591b066'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.157472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1173/2351] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:58:54 2022] DELETE /identity/v3/users/f7ed79c2218b4f89ad6a022aa591b066 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:55.429810 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:55.431328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:55.445156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8687042-4a4b-4229-9836-39e0f10d6ec2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.501663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.502568 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.502857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.503136 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] PATH_INFO: `/v3/projects/2cbab03e6eed44d29e73d9b21dca0711` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.504321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbab03e6eed44d29e73d9b21dca0711)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:55.506474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:55.557093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbab03e6eed44d29e73d9b21dca0711', 'request_id': 'req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.572745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbab03e6eed44d29e73d9b21dca0711', 'request_id': 'req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.578889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbab03e6eed44d29e73d9b21dca0711', 'request_id': 'req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.590068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] The token cache is being invalidate because project 2cbab03e6eed44d29e73d9b21dca0711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:58:55.590384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.591068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92bd1d58-c9cf-44bb-b73b-20d46f081fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:58:55.592636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1179/2352] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:58:55 2022] DELETE /identity/v3/projects/2cbab03e6eed44d29e73d9b21dca0711 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:55.598420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0fb81-ee02-4ccc-88c5-72ed4bceeca9 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.598915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0fb81-ee02-4ccc-88c5-72ed4bceeca9 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.599027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0fb81-ee02-4ccc-88c5-72ed4bceeca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.616870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-95e0fb81-ee02-4ccc-88c5-72ed4bceeca9 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:55.618328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-95e0fb81-ee02-4ccc-88c5-72ed4bceeca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:55.681273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1174/2353] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:55.688871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a4e47-d75c-4a1c-941a-de81dbd6b034 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.689165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a4e47-d75c-4a1c-941a-de81dbd6b034 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.689445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a4e47-d75c-4a1c-941a-de81dbd6b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.708624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ab9a4e47-d75c-4a1c-941a-de81dbd6b034 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:55.709844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ab9a4e47-d75c-4a1c-941a-de81dbd6b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:55.717879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1180/2354] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:55.722495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0fb81-ee02-4ccc-88c5-72ed4bceeca9 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:55.732089 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0fb81-ee02-4ccc-88c5-72ed4bceeca9 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.736731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.737376 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.737655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.737926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.738701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 14:58:55.739031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:55.740624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:55.751992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1175/2355] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 14:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 14:58:55.756336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a4e47-d75c-4a1c-941a-de81dbd6b034 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:55.765635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a4e47-d75c-4a1c-941a-de81dbd6b034 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.770317 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.770966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.771249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.771522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.772216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:55.774115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:55.803109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1181/2356] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 14:58:55 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:58:55.807356 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:55.817027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3cfa1-5504-4890-ad8e-1c3927d69812 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.874526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.875193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.875499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.875826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.876533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:55.878505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:55.902958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1176/2357] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 14:58:55 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 14:58:55.904179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:55.914706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d550e-1718-4878-8548-80f18865ae43 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.919981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.920659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.921138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.921839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.922215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:55.924214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:55.935548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1182/2358] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:58:55.939695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:55.949400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798261-c158-4a60-b4ba-e1c833f99391 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.954033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abbdb0-f76f-4e8a-8176-4d8383cc89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.955048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbdb0-f76f-4e8a-8176-4d8383cc89f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.955328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbdb0-f76f-4e8a-8176-4d8383cc89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.955575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbdb0-f76f-4e8a-8176-4d8383cc89f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:55.956322 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abbdb0-f76f-4e8a-8176-4d8383cc89f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:55.957897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abbdb0-f76f-4e8a-8176-4d8383cc89f5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:55.970766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1177/2359] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 14:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 14:58:55.972344 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:55.984670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03509-3057-4ef9-996f-530c5cdc7491 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:55.989864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:55.990813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:55.991097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:55.991372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] PATH_INFO: `/v3/projects/1c2a45894d384e12babf48ccd4f0f00c/users/8388be6a488f4d869829c877efb8287c/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:56.006114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2a45894d384e12babf48ccd4f0f00c, user_id=8388be6a488f4d869829c877efb8287c, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:56.008809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:56.022849 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1183/2360] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 14:58:55 2022] PUT /identity/v3/projects/1c2a45894d384e12babf48ccd4f0f00c/users/8388be6a488f4d869829c877efb8287c/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:58:56.034395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:56.034716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:56.034967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:56.061643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] MFA Rules not processed for user `8388be6a488f4d869829c877efb8287c`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:58:56.062871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:56.128825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1178/2361] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:58:56.139841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:56.141675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:56.206230 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef96980-f435-482e-ba51-f9ad238f7d02 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:56.212844 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:56.213679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:56.213960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:56.214268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:56.226191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:56.227848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:56.237713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1184/2362] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:58:57.507904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:58:57.509480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:57.587497 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482c5b-546e-4119-9b3a-81b600eb97b7 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:58:57.593427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:58:57.594113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:58:57.594433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:58:57.594707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:58:57.596627 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:58:57.608750 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:58:57.610441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:58:57.621048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1179/2363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:58:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:59:01.520500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:01.523804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:01.540270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095437-7ddf-411c-b023-5981bd0d9755 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:01.552231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36256824-fb00-4620-a423-cd87863eebbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:01.553141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256824-fb00-4620-a423-cd87863eebbf service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:01.553620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256824-fb00-4620-a423-cd87863eebbf service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:01.554115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256824-fb00-4620-a423-cd87863eebbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:01.556159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-36256824-fb00-4620-a423-cd87863eebbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:01.568806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36256824-fb00-4620-a423-cd87863eebbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:01.570419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36256824-fb00-4620-a423-cd87863eebbf service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:01.581652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1185/2364] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:59:06.159408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:06.228529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb1906-e925-42eb-bda1-d3071bf19958 service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:06.233871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:06.234877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:06.235159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:06.235433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] PATH_INFO: `/v3/users/8388be6a488f4d869829c877efb8287c` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:06.236837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8388be6a488f4d869829c877efb8287c)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:06.238792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:06.300287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8388be6a488f4d869829c877efb8287c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.306974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8388be6a488f4d869829c877efb8287c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.307669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8388be6a488f4d869829c877efb8287c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.308297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8388be6a488f4d869829c877efb8287c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.323137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8388be6a488f4d869829c877efb8287c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.337544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1180/2365] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 14:59:06 2022] DELETE /identity/v3/users/8388be6a488f4d869829c877efb8287c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:59:06.342198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:06.342686 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:06.342786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:06.360115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:59:06.361393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:06.430266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1186/2366] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 14:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:59:06.440074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:06.441674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:06.502623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bac72-731a-4e67-9c5f-c954970a2b83 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:06.506572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f4d9-506e-4a9b-b7bf-9051b9beacb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:06.507214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f4d9-506e-4a9b-b7bf-9051b9beacb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:06.507498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f4d9-506e-4a9b-b7bf-9051b9beacb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:06.507751 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f4d9-506e-4a9b-b7bf-9051b9beacb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:06.516972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141f4d9-506e-4a9b-b7bf-9051b9beacb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:06.518447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141f4d9-506e-4a9b-b7bf-9051b9beacb9 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:06.528448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1181/2367] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:59:06.806291 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:06.807860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:06.820464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aeff-0472-452d-9b83-1addceb1f321 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:06.825146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:06.826009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:06.826295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:06.826582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] PATH_INFO: `/v3/projects/1c2a45894d384e12babf48ccd4f0f00c` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:06.827728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2a45894d384e12babf48ccd4f0f00c)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:06.830064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:06.880662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2a45894d384e12babf48ccd4f0f00c', 'request_id': 'req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.889263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2a45894d384e12babf48ccd4f0f00c', 'request_id': 'req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.895206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2a45894d384e12babf48ccd4f0f00c', 'request_id': 'req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.906593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] The token cache is being invalidate because project 1c2a45894d384e12babf48ccd4f0f00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 14:59:06.906877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.907590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 14:59:06.909168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1187/2368] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 14:59:06 2022] DELETE /identity/v3/projects/1c2a45894d384e12babf48ccd4f0f00c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 14:59:11.773113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c05a4e-7abc-41fb-ac01-ec635352cc95 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:11.773593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c05a4e-7abc-41fb-ac01-ec635352cc95 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:11.773706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c05a4e-7abc-41fb-ac01-ec635352cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:11.791730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-85c05a4e-7abc-41fb-ac01-ec635352cc95 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:59:11.792932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-85c05a4e-7abc-41fb-ac01-ec635352cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:11.852718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1182/2369] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:59:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:59:11.908676 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:11.910301 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:11.981937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6afeb-6ce2-4f83-a62e-8dc3b7ed0ad7 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:11.987162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952afa7-2a2f-4414-9ea6-b49641d12db5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:11.987826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952afa7-2a2f-4414-9ea6-b49641d12db5 service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:11.988090 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952afa7-2a2f-4414-9ea6-b49641d12db5 service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:11.988365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952afa7-2a2f-4414-9ea6-b49641d12db5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:11.997563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952afa7-2a2f-4414-9ea6-b49641d12db5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:11.999187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952afa7-2a2f-4414-9ea6-b49641d12db5 service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:12.007341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1188/2370] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:59:25.083330 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606ee6c-f60e-412b-a2e0-886cf15b8807 None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.083940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606ee6c-f60e-412b-a2e0-886cf15b8807 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.083940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606ee6c-f60e-412b-a2e0-886cf15b8807 None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.085681 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1183/2371] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:59:25.092427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab203bdd-c399-43f0-9aee-857641a2b0da None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.092960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab203bdd-c399-43f0-9aee-857641a2b0da None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.093067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab203bdd-c399-43f0-9aee-857641a2b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.112764 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ab203bdd-c399-43f0-9aee-857641a2b0da None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:59:25.113987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ab203bdd-c399-43f0-9aee-857641a2b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:25.181717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1189/2372] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:59:25.193274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606ee6c-f60e-412b-a2e0-886cf15b8807 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:25.195276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0606ee6c-f60e-412b-a2e0-886cf15b8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:25.251110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606ee6c-f60e-412b-a2e0-886cf15b8807 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:25.254643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cb422-84cd-47dd-864d-1635de0fd0c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:25.255286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cb422-84cd-47dd-864d-1635de0fd0c3 service glance] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.255565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cb422-84cd-47dd-864d-1635de0fd0c3 service glance] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.255836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cb422-84cd-47dd-864d-1635de0fd0c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.265608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cb422-84cd-47dd-864d-1635de0fd0c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:25.267060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cb422-84cd-47dd-864d-1635de0fd0c3 service glance] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:25.277351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1184/2373] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:59:25.361190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a00b-c162-4ebb-b67b-954f15c9c7d7 None None] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.361478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a00b-c162-4ebb-b67b-954f15c9c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.361753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a00b-c162-4ebb-b67b-954f15c9c7d7 None None] PATH_INFO: `/` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.363614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1190/2374] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:59:25.368521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69e487-a542-4fb0-ab88-46de6115bf29 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.368809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69e487-a542-4fb0-ab88-46de6115bf29 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.369110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69e487-a542-4fb0-ab88-46de6115bf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.387326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7e69e487-a542-4fb0-ab88-46de6115bf29 None None] MFA Rules not processed for user `750a6a7b35204c47ac16a584e7e71713`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:59:25.388509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7e69e487-a542-4fb0-ab88-46de6115bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:25.443887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1185/2375] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:59:25.457042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a00b-c162-4ebb-b67b-954f15c9c7d7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:25.459666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1a58a00b-c162-4ebb-b67b-954f15c9c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:25.474523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a00b-c162-4ebb-b67b-954f15c9c7d7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:25.479537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3a69-d0b7-473a-b8fe-fc7bb6b7ac41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:25.480191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3a69-d0b7-473a-b8fe-fc7bb6b7ac41 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.480493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3a69-d0b7-473a-b8fe-fc7bb6b7ac41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.480757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3a69-d0b7-473a-b8fe-fc7bb6b7ac41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.488605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3a69-d0b7-473a-b8fe-fc7bb6b7ac41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:25.490149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3a69-d0b7-473a-b8fe-fc7bb6b7ac41 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:25.498229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1191/2376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 14:59:25.594925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c7dc-c61d-49be-8407-940aea3b7b8b None None] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.595222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c7dc-c61d-49be-8407-940aea3b7b8b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.595483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c7dc-c61d-49be-8407-940aea3b7b8b None None] PATH_INFO: `/` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.597449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1186/2377] 10.222.0.43 () {54 vars in 921 bytes} [Thu Mar 24 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 24 14:59:25.603218 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a176f-094b-4d04-83e5-8c3f370f5ddd None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.603537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a176f-094b-4d04-83e5-8c3f370f5ddd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.603845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a176f-094b-4d04-83e5-8c3f370f5ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.623106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a21a176f-094b-4d04-83e5-8c3f370f5ddd None None] MFA Rules not processed for user `1cc15d4ea22b441ab70b958fba26a07f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:59:25.624288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a21a176f-094b-4d04-83e5-8c3f370f5ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:25.633819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1192/2378] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Mar 24 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:59:25.650207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c7dc-c61d-49be-8407-940aea3b7b8b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:25.664942 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c7dc-c61d-49be-8407-940aea3b7b8b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:25.668414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:25.669048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:25.669326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:25.669597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:25.680479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:25.681923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:25.692867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1187/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 14:59:27.443133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f4154-c00d-4f09-a7b0-8dd68a4b540a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:27.443616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f4154-c00d-4f09-a7b0-8dd68a4b540a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:27.443718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f4154-c00d-4f09-a7b0-8dd68a4b540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:27.461402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1f8f4154-c00d-4f09-a7b0-8dd68a4b540a None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:59:27.462611 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1f8f4154-c00d-4f09-a7b0-8dd68a4b540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:27.470045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1193/2380] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 14:59:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:59:27.482235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:27.493061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2665586-350b-4af0-86c6-5c95e05b0827 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:27.497918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:27.498592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:27.498870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:27.499143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:27.507286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:27.508859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:27.517113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1188/2381] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:59:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 14:59:43.327244 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61155d8b-824b-4d69-9037-24286675e735 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:43.327823 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61155d8b-824b-4d69-9037-24286675e735 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:43.327823 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61155d8b-824b-4d69-9037-24286675e735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:43.346864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-61155d8b-824b-4d69-9037-24286675e735 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 14:59:43.348115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-61155d8b-824b-4d69-9037-24286675e735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 14:59:43.355978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1194/2382] 10.222.0.43 () {58 vars in 967 bytes} [Thu Mar 24 14:59:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 14:59:43.368413 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 14:59:43.379541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d91ed1-d9e5-47d3-acc5-0de77bbd1caf service swift] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 14:59:43.384850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 14:59:43.385482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 14:59:43.385765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 14:59:43.386040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 14:59:43.394496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 14:59:43.396113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 14:59:43.403922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1189/2383] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 14:59:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:00:10.339661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61155d8b-824b-4d69-9037-24286675e735 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:10.341140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-61155d8b-824b-4d69-9037-24286675e735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:10.352585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61155d8b-824b-4d69-9037-24286675e735 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:10.356835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:10.357549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:10.357815 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:10.358145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:10.360303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:10.430252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:10.431835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:10.441399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1195/2384] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:11.530325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:11.539684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa471ed5-5ba2-488e-9133-2b48e170b957 service swift] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:11.543638 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:11.544270 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:11.544549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:11.544795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:11.546747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:11.559345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:11.560759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:11.570803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1190/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:13.949760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:13.952324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:13.970540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237abae4-e23c-4ee7-8061-f2d582eb6d7e service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:13.975772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:13.976778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:13.977129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:13.978016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] PATH_INFO: `/v3/users/212d3a1984a34761a3b06eff9f26d44f` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:13.980427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=212d3a1984a34761a3b06eff9f26d44f)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:13.982533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:14.052546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212d3a1984a34761a3b06eff9f26d44f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.064988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212d3a1984a34761a3b06eff9f26d44f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.071566 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212d3a1984a34761a3b06eff9f26d44f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.079971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212d3a1984a34761a3b06eff9f26d44f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.080602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c473228c-6e2c-45cb-8b11-7241a148df59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212d3a1984a34761a3b06eff9f26d44f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.086779 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1196/2386] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:13 2022] DELETE /identity/v3/users/212d3a1984a34761a3b06eff9f26d44f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:14.524813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:14.547010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbe486-c5b9-4a04-81fd-c2f171003a75 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:14.610151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:14.611036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:14.611316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:14.611592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] PATH_INFO: `/v3/projects/d60ef6516f464105bbb22a953fe3a9e8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:14.612836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60ef6516f464105bbb22a953fe3a9e8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:14.614960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:14.672659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60ef6516f464105bbb22a953fe3a9e8', 'request_id': 'req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.681291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60ef6516f464105bbb22a953fe3a9e8', 'request_id': 'req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.687303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60ef6516f464105bbb22a953fe3a9e8', 'request_id': 'req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.700303 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] The token cache is being invalidate because project d60ef6516f464105bbb22a953fe3a9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:14.700832 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.701805 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fe27980d-a350-43e1-b2bf-58daf5e0e0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:14.703646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1191/2387] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:14 2022] DELETE /identity/v3/projects/d60ef6516f464105bbb22a953fe3a9e8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:14.711461 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bc00c-be23-4f35-a71d-0d5e901b5f16 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:14.712055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bc00c-be23-4f35-a71d-0d5e901b5f16 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:14.712607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bc00c-be23-4f35-a71d-0d5e901b5f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:14.733385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-295bc00c-be23-4f35-a71d-0d5e901b5f16 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:14.734637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-295bc00c-be23-4f35-a71d-0d5e901b5f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:14.791888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1197/2388] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:14.801241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2750e-4ef6-4e19-9bab-4b418f079616 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:14.801552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2750e-4ef6-4e19-9bab-4b418f079616 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:14.801831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2750e-4ef6-4e19-9bab-4b418f079616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:14.821306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-25d2750e-4ef6-4e19-9bab-4b418f079616 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:14.822558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-25d2750e-4ef6-4e19-9bab-4b418f079616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:14.842132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1192/2389] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:14.846474 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bc00c-be23-4f35-a71d-0d5e901b5f16 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:14.857378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bc00c-be23-4f35-a71d-0d5e901b5f16 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:14.874324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:14.875145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:14.875642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:14.876186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:14.877138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:14.877453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:14.882684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:14.893716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1198/2390] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:00:14.898277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2750e-4ef6-4e19-9bab-4b418f079616 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:14.908494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2750e-4ef6-4e19-9bab-4b418f079616 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:14.913401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:14.914076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:14.914386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:14.914661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:14.915390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:14.917438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:14.953148 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1193/2391] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:14 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:14.957861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:14.967805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75300-88c8-435c-abb8-8985cb07a925 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.046650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.047872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.049887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.050437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.051361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.053582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.080876 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1199/2392] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:14 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:15.081414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.092046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c05bae-47f0-42d6-bfa8-ff5c768a7c26 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.107394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.108104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.108588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.108920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.109925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.111898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.116831 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.120012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.140261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1194/2393] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:15.149002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.156652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a94e4-e37f-4d80-b685-70bf5071525d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.166388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d514e-ad17-4948-8abf-6b5ab869d844 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.167199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.168740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.169370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.170076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] PATH_INFO: `/v3/users/011fa6cf9d534cd2a7e3d80326eec76f` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.172359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011fa6cf9d534cd2a7e3d80326eec76f)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.173760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.174531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.174801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.175070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.176012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.177810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.178016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.190515 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1195/2394] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:15.198220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.210129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630448e4-b0f7-453b-9a44-31ea24cb1116 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.215838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576abe77-77ac-48d4-97f2-3d71c6702ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.216997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abe77-77ac-48d4-97f2-3d71c6702ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.217502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abe77-77ac-48d4-97f2-3d71c6702ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.217966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576abe77-77ac-48d4-97f2-3d71c6702ca4 admin admin] PATH_INFO: `/v3/projects/f27bbe729dff46489f1b2c7ac7d54855/users/49f74c46eaf94fcfa906ca6eea716bb4/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.237154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576abe77-77ac-48d4-97f2-3d71c6702ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27bbe729dff46489f1b2c7ac7d54855, user_id=49f74c46eaf94fcfa906ca6eea716bb4, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.240773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576abe77-77ac-48d4-97f2-3d71c6702ca4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.256173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1196/2395] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:15 2022] PUT /identity/v3/projects/f27bbe729dff46489f1b2c7ac7d54855/users/49f74c46eaf94fcfa906ca6eea716bb4/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:15.271355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.271649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.271909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.278035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011fa6cf9d534cd2a7e3d80326eec76f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.294209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011fa6cf9d534cd2a7e3d80326eec76f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.302706 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011fa6cf9d534cd2a7e3d80326eec76f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.313745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011fa6cf9d534cd2a7e3d80326eec76f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.315525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011fa6cf9d534cd2a7e3d80326eec76f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.322967 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1200/2396] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:15 2022] DELETE /identity/v3/users/011fa6cf9d534cd2a7e3d80326eec76f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:15.323745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] MFA Rules not processed for user `49f74c46eaf94fcfa906ca6eea716bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:15.325230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.406854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1197/2397] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:15.411382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.412852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.478652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109baf-27be-42b4-af4e-c991a1bdca50 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.484059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.484745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.485055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.485328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.486039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.488003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.503343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.505023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.519644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc0aa-074d-4e64-b248-c31eea036660 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.519841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1201/2398] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:15.523540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.576024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.576895 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.577176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.577452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] PATH_INFO: `/v3/projects/546c38a2579b41db9797bffa819ca65b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.578661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=546c38a2579b41db9797bffa819ca65b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.581283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.584572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dea01-bbc5-46c2-8279-f8a050fe3581 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.589632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.590324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.590604 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.590874 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.591567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.593457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.614830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1202/2399] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:15.618950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.626887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546c38a2579b41db9797bffa819ca65b', 'request_id': 'req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.628977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033767-af2b-4914-8fa7-a533d2b8314b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.635391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546c38a2579b41db9797bffa819ca65b', 'request_id': 'req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.640922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546c38a2579b41db9797bffa819ca65b', 'request_id': 'req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.652209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] The token cache is being invalidate because project 546c38a2579b41db9797bffa819ca65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:15.652516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.653226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d4ab1ec5-5ad3-44b4-adc1-fce939dca1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:15.654854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1198/2400] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:15 2022] DELETE /identity/v3/projects/546c38a2579b41db9797bffa819ca65b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:15.659531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada21e-d7db-492b-b0ed-b875ba520821 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.659816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada21e-d7db-492b-b0ed-b875ba520821 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.660116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada21e-d7db-492b-b0ed-b875ba520821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.677538 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e7ada21e-d7db-492b-b0ed-b875ba520821 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:15.678897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e7ada21e-d7db-492b-b0ed-b875ba520821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.688625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.689349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.689637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.689937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.690738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.692416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.702368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1203/2401] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:15.706859 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.708536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.720626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69977-c167-49a7-8d3b-bd4aac7bf3de admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.725451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.726356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.726678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.726997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] PATH_INFO: `/v3/projects/95388f13b72e4c418bc44d31e9961cb2/users/b24a1c6991fa4968b324d3bf9174c5ce/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.737603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1199/2402] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:15.741357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95388f13b72e4c418bc44d31e9961cb2, user_id=b24a1c6991fa4968b324d3bf9174c5ce, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.744685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.745478 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417506a2-a229-4ade-b6f1-60a2f0337940 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.745767 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417506a2-a229-4ade-b6f1-60a2f0337940 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.746044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417506a2-a229-4ade-b6f1-60a2f0337940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.759071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1204/2403] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:15 2022] PUT /identity/v3/projects/95388f13b72e4c418bc44d31e9961cb2/users/b24a1c6991fa4968b324d3bf9174c5ce/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:15.763094 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.764425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-417506a2-a229-4ade-b6f1-60a2f0337940 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:15.765662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-417506a2-a229-4ade-b6f1-60a2f0337940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.820972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763523d-e670-4642-8440-e0ed29beaf9b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.824006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1200/2404] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:15.827958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.828295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417506a2-a229-4ade-b6f1-60a2f0337940 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.828558 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.828842 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.829117 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.830197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.832194 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.837611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417506a2-a229-4ade-b6f1-60a2f0337940 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.842441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.842907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1205/2405] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:15.843086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.843368 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.843645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.844364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:15.844671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.846292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.846721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.856272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcb411-5f1d-4be6-8abe-d4acac70a256 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.861317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1201/2406] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:00:15.861627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a87093-8b9d-4f48-b064-ebc37af4a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.862279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.862552 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87093-8b9d-4f48-b064-ebc37af4a1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.867125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87093-8b9d-4f48-b064-ebc37af4a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.867125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a87093-8b9d-4f48-b064-ebc37af4a1e4 admin admin] PATH_INFO: `/v3/projects/95388f13b72e4c418bc44d31e9961cb2/users/b24a1c6991fa4968b324d3bf9174c5ce/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.867125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a87093-8b9d-4f48-b064-ebc37af4a1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95388f13b72e4c418bc44d31e9961cb2, user_id=b24a1c6991fa4968b324d3bf9174c5ce, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.868353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a87093-8b9d-4f48-b064-ebc37af4a1e4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.879113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7bcc1-221d-4361-83a4-cbcd9702811c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:15.879576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1206/2407] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:15 2022] PUT /identity/v3/projects/95388f13b72e4c418bc44d31e9961cb2/users/b24a1c6991fa4968b324d3bf9174c5ce/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:15.889603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.889910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.890235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.916892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] MFA Rules not processed for user `b24a1c6991fa4968b324d3bf9174c5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:15.918114 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:15.937768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:15.938485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:15.938787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:15.939064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:15.939967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:15.941859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:15.971193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1202/2408] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:15.972465 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.986927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1207/2409] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:15.998280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:15.999781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:16.034065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357135-6191-4d8f-b439-d3c84a1103fa admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.038812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.039549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.039900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.040252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.041008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.043030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.054343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145df4a7-af31-4259-a9b1-fd2ced570bf1 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.062319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1203/2410] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:15 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:16.066798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.076621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ecdf-bc01-48c0-affb-e79740284501 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.082044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.082673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.082960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.083240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.083973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.085567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.095602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1204/2411] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:16.099341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.103019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c295c08-b1d0-4fc0-acbc-089fc940f002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.103670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295c08-b1d0-4fc0-acbc-089fc940f002 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.103953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295c08-b1d0-4fc0-acbc-089fc940f002 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.104229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295c08-b1d0-4fc0-acbc-089fc940f002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.106100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1c295c08-b1d0-4fc0-acbc-089fc940f002 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:16.109904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b043-7c2e-4966-845d-58b4e0900fba admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.114894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.115552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.115867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.116211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.116958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.118611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.132314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1205/2412] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:16.133556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.143388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53fa17-09a9-4a01-bc7a-90490f510282 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.148046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.148940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.149211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.149482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] PATH_INFO: `/v3/projects/e761719069f34b17b36e0efd0476bc93/users/c4d3c5ad7b224657a6c8bd9aa849568e/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.163762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c295c08-b1d0-4fc0-acbc-089fc940f002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.163927 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e761719069f34b17b36e0efd0476bc93, user_id=c4d3c5ad7b224657a6c8bd9aa849568e, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.165209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c295c08-b1d0-4fc0-acbc-089fc940f002 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.166510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.174451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1208/2413] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:16.179575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1206/2414] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:16 2022] PUT /identity/v3/projects/e761719069f34b17b36e0efd0476bc93/users/c4d3c5ad7b224657a6c8bd9aa849568e/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:16.190441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895bc6-3896-409d-8f0a-09c6412d53dd None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.190733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895bc6-3896-409d-8f0a-09c6412d53dd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.191007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895bc6-3896-409d-8f0a-09c6412d53dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.216735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1b895bc6-3896-409d-8f0a-09c6412d53dd None None] MFA Rules not processed for user `c4d3c5ad7b224657a6c8bd9aa849568e`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:16.217962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1b895bc6-3896-409d-8f0a-09c6412d53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:16.280352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1209/2415] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:16.285053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.358116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d588f8-05b5-4bfb-affd-155271699074 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.361720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.362502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.362864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.363254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.370870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.373078 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.405200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1207/2416] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:16 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:16.406402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895bc6-3896-409d-8f0a-09c6412d53dd None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.418591 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b895bc6-3896-409d-8f0a-09c6412d53dd None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.496420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.496420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.496420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.496791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.497536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.500124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.522473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1210/2417] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:16 2022] POST /identity/v3/users => generated 308 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:16.526335 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.545361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d0ef-0fa9-4f05-9c4a-fd7619db536f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.552187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.552909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.553204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.553565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.554405 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.556005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.567307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1208/2418] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:16.571297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.581470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266abc67-6e74-4057-a7d2-fc421c273c39 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.586661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.587487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.587770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.588051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] PATH_INFO: `/v3/projects/5d63ea2e60ab4e7689ed1f88db41b2aa/users/b175da893f5249218b13d16774a2047c/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.603696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d63ea2e60ab4e7689ed1f88db41b2aa, user_id=b175da893f5249218b13d16774a2047c, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.606452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.620806 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1211/2419] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:16 2022] PUT /identity/v3/projects/5d63ea2e60ab4e7689ed1f88db41b2aa/users/b175da893f5249218b13d16774a2047c/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:16.624906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.635154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9583be-62be-4cdb-9281-a329e3293bdb admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.695224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701be872-20db-4b8c-8811-d2575821defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.695896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be872-20db-4b8c-8811-d2575821defe admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.696181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be872-20db-4b8c-8811-d2575821defe admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.696456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701be872-20db-4b8c-8811-d2575821defe admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.697191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701be872-20db-4b8c-8811-d2575821defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.698863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701be872-20db-4b8c-8811-d2575821defe admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.708964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1209/2420] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:16.713543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.724054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6255e-b444-4fd0-aa19-1b8c630e49b5 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.729561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.730512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.730794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.731071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] PATH_INFO: `/v3/projects/5d63ea2e60ab4e7689ed1f88db41b2aa/users/b175da893f5249218b13d16774a2047c/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.733197 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d63ea2e60ab4e7689ed1f88db41b2aa, user_id=b175da893f5249218b13d16774a2047c, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.735895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.748144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1212/2421] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:16 2022] PUT /identity/v3/projects/5d63ea2e60ab4e7689ed1f88db41b2aa/users/b175da893f5249218b13d16774a2047c/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:16.758313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8427-4f5b-4ccf-8957-76c6a4aa5451 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.758604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8427-4f5b-4ccf-8957-76c6a4aa5451 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.758878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee8427-4f5b-4ccf-8957-76c6a4aa5451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.785639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-47ee8427-4f5b-4ccf-8957-76c6a4aa5451 None None] MFA Rules not processed for user `b175da893f5249218b13d16774a2047c`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:16.786865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-47ee8427-4f5b-4ccf-8957-76c6a4aa5451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:16.857576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1210/2422] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:16.868777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:16.922312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223794b3-408a-4b52-846a-60ab4a10e533 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:16.926201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4663a-d5f8-4117-b010-5269d5f23fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:16.926840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4663a-d5f8-4117-b010-5269d5f23fbc service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:16.927120 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4663a-d5f8-4117-b010-5269d5f23fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:16.927393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4663a-d5f8-4117-b010-5269d5f23fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:16.936761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4663a-d5f8-4117-b010-5269d5f23fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:16.938221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4663a-d5f8-4117-b010-5269d5f23fbc service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:16.948154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1213/2423] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:17.092459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8427-4f5b-4ccf-8957-76c6a4aa5451 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:17.159381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee8427-4f5b-4ccf-8957-76c6a4aa5451 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:17.165314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:17.166227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:17.166507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:17.166788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] PATH_INFO: `/v3/users/c4d3c5ad7b224657a6c8bd9aa849568e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:17.168132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d3c5ad7b224657a6c8bd9aa849568e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:17.170067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:17.221430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d3c5ad7b224657a6c8bd9aa849568e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.228510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d3c5ad7b224657a6c8bd9aa849568e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.229232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d3c5ad7b224657a6c8bd9aa849568e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.229884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d3c5ad7b224657a6c8bd9aa849568e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.242664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d3c5ad7b224657a6c8bd9aa849568e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.257491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1211/2424] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:17 2022] DELETE /identity/v3/users/c4d3c5ad7b224657a6c8bd9aa849568e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:17.262290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:17.262792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:17.262913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:17.281188 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:17.282414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:17.344247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1214/2425] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:17.354358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:17.356061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:17.414971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24eb2e-acfe-4870-aa13-ce8d498d8e59 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:17.418593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:17.419252 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:17.419527 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:17.419798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:17.428778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:17.430235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:17.439859 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1212/2426] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:17.753713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:17.755524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:17.770067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b9607-3727-4a7d-ac4d-0abeb0134067 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:17.775465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:17.776406 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:17.776691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:17.777045 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] PATH_INFO: `/v3/projects/e761719069f34b17b36e0efd0476bc93` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:17.778292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e761719069f34b17b36e0efd0476bc93)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:17.780589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:17.858620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e761719069f34b17b36e0efd0476bc93', 'request_id': 'req-274d283c-9092-42aa-a184-61565dd73fc3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.869865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e761719069f34b17b36e0efd0476bc93', 'request_id': 'req-274d283c-9092-42aa-a184-61565dd73fc3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.876243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e761719069f34b17b36e0efd0476bc93', 'request_id': 'req-274d283c-9092-42aa-a184-61565dd73fc3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.887595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] The token cache is being invalidate because project e761719069f34b17b36e0efd0476bc93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:17.887880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.888518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:17.890035 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1215/2427] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:17 2022] DELETE /identity/v3/projects/e761719069f34b17b36e0efd0476bc93 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:17.894116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:17.903794 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972c5c-ef40-489a-9922-fb5cc41ce3e1 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:17.959903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:17.960736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:17.961045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:17.961332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] PATH_INFO: `/v3/users/b175da893f5249218b13d16774a2047c` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:17.962672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b175da893f5249218b13d16774a2047c)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:17.964652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.011367 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b175da893f5249218b13d16774a2047c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.018309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b175da893f5249218b13d16774a2047c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.018986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b175da893f5249218b13d16774a2047c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.019576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b175da893f5249218b13d16774a2047c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.030736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-18e5a503-39a9-4b39-b3c8-1bdc12427d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b175da893f5249218b13d16774a2047c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.043897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1213/2428] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:17 2022] DELETE /identity/v3/users/b175da893f5249218b13d16774a2047c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:18.324128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:18.325720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:18.341728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d283c-9092-42aa-a184-61565dd73fc3 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:18.398269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:18.399131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.399411 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.399703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] PATH_INFO: `/v3/projects/5d63ea2e60ab4e7689ed1f88db41b2aa` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.400851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d63ea2e60ab4e7689ed1f88db41b2aa)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:18.402789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.458462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d63ea2e60ab4e7689ed1f88db41b2aa', 'request_id': 'req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.474341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d63ea2e60ab4e7689ed1f88db41b2aa', 'request_id': 'req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.480386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d63ea2e60ab4e7689ed1f88db41b2aa', 'request_id': 'req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.494046 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] The token cache is being invalidate because project 5d63ea2e60ab4e7689ed1f88db41b2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:18.494337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.495352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ca3f5280-f56e-4c5f-b93d-19a61bb87dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:18.497841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1216/2429] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:18 2022] DELETE /identity/v3/projects/5d63ea2e60ab4e7689ed1f88db41b2aa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:18.504630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14329f8-81a9-4f23-bf73-4d601f1421e0 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.504995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14329f8-81a9-4f23-bf73-4d601f1421e0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.505278 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14329f8-81a9-4f23-bf73-4d601f1421e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.525901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e14329f8-81a9-4f23-bf73-4d601f1421e0 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:18.527169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e14329f8-81a9-4f23-bf73-4d601f1421e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:18.596081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1214/2430] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:18.604192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf44e50-0b4a-4347-90a6-b611a2229130 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.604521 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf44e50-0b4a-4347-90a6-b611a2229130 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.604914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf44e50-0b4a-4347-90a6-b611a2229130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.626401 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5cf44e50-0b4a-4347-90a6-b611a2229130 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:18.627587 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5cf44e50-0b4a-4347-90a6-b611a2229130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:18.636606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1217/2431] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:18.641043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14329f8-81a9-4f23-bf73-4d601f1421e0 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:18.651229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14329f8-81a9-4f23-bf73-4d601f1421e0 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:18.656350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:18.656996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.657279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.657557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.658323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:18.658633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:18.660229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.672099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1215/2432] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:00:18.676630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf44e50-0b4a-4347-90a6-b611a2229130 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:18.686271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf44e50-0b4a-4347-90a6-b611a2229130 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:18.692023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:18.692704 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.692984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.693250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.693939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:18.695868 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.725248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1218/2433] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:18 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:18.730691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:18.744870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf4cbf-fa6a-45b4-a2c6-78a08e323587 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:18.802591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:18.803248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.803527 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.803793 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.804496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:18.806416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.830898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1216/2434] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:18 2022] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:18.832078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:18.842682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40513c-c56e-4bf1-8308-3749757437d9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:18.847563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:18.848963 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.849340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.849825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.851071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:18.853143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.868782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1219/2435] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:18.870010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:18.880170 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c390-eafc-4179-b03b-9b965dc3471e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:18.885050 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26baa60-10d9-439b-a207-e7c174e34fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:18.885708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26baa60-10d9-439b-a207-e7c174e34fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.886021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26baa60-10d9-439b-a207-e7c174e34fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.886334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26baa60-10d9-439b-a207-e7c174e34fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.887068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26baa60-10d9-439b-a207-e7c174e34fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:18.888652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26baa60-10d9-439b-a207-e7c174e34fc6 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.902408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1217/2436] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:18.903548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:18.915397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa59fbe-de4e-4ac6-b7f3-7238178778c1 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:18.921515 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:18.922593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.923061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.923483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] PATH_INFO: `/v3/projects/d213695c65664b1590897bd5879a97ed/users/d17f255b832f44379ebbc6bb29e6cb2d/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:18.948798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d213695c65664b1590897bd5879a97ed, user_id=d17f255b832f44379ebbc6bb29e6cb2d, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:18.951773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:18.971625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1220/2437] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:18 2022] PUT /identity/v3/projects/d213695c65664b1590897bd5879a97ed/users/d17f255b832f44379ebbc6bb29e6cb2d/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:18.984726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac9f2a-9cf4-4a3a-b382-7afb679e42ec None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:18.985064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac9f2a-9cf4-4a3a-b382-7afb679e42ec None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:18.985433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac9f2a-9cf4-4a3a-b382-7afb679e42ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.012780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f6ac9f2a-9cf4-4a3a-b382-7afb679e42ec None None] MFA Rules not processed for user `d17f255b832f44379ebbc6bb29e6cb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:19.014115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f6ac9f2a-9cf4-4a3a-b382-7afb679e42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:19.077091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1218/2438] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:18 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:19.081951 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.141592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b80b-783f-4a31-9188-91beb1b0d505 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.146677 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.147329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.147606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.147878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.148602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.150518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:19.176653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1221/2439] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:19 2022] POST /identity/v3/projects => generated 355 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:19.180906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac9f2a-9cf4-4a3a-b382-7afb679e42ec None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.196769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac9f2a-9cf4-4a3a-b382-7afb679e42ec None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.255175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.255804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.256080 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.256357 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.257075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.259071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:19.280320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1219/2440] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:19 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:19.284360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.294955 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb1c25-be42-4e69-bcf6-2ea5d10c5504 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.300817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.301483 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.301763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.302034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.302789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.304470 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:19.316416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1222/2441] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:19.320480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.331067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ac40f-203a-4148-bc90-9a271c787435 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.336870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.337739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.338023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.338343 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] PATH_INFO: `/v3/projects/3bc569d3f0bd4316816ecc5c897fe950/users/4f680a4dc0b0413cb8c33de2c7e3653b/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.354185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc569d3f0bd4316816ecc5c897fe950, user_id=4f680a4dc0b0413cb8c33de2c7e3653b, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.356801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:19.371761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1220/2442] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:19 2022] PUT /identity/v3/projects/3bc569d3f0bd4316816ecc5c897fe950/users/4f680a4dc0b0413cb8c33de2c7e3653b/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:19.375650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.385573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d440d-041c-45af-aedd-40d19158f61d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.584208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0d85f-ca3b-4880-9dc5-707567147067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.585170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0d85f-ca3b-4880-9dc5-707567147067 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.585715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0d85f-ca3b-4880-9dc5-707567147067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.585990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0d85f-ca3b-4880-9dc5-707567147067 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.586812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0d85f-ca3b-4880-9dc5-707567147067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.588364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0d85f-ca3b-4880-9dc5-707567147067 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:19.598644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1223/2443] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:19.603153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.614037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6a3f-ad35-45e0-b8f4-d1d98b30b410 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.619297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.620180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.620481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.620753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] PATH_INFO: `/v3/projects/3bc569d3f0bd4316816ecc5c897fe950/users/4f680a4dc0b0413cb8c33de2c7e3653b/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.622976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc569d3f0bd4316816ecc5c897fe950, user_id=4f680a4dc0b0413cb8c33de2c7e3653b, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.625656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:19.636350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1221/2444] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:19 2022] PUT /identity/v3/projects/3bc569d3f0bd4316816ecc5c897fe950/users/4f680a4dc0b0413cb8c33de2c7e3653b/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:19.646496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165393cd-1d2f-4eb1-87ed-a2fd004adb29 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.646783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165393cd-1d2f-4eb1-87ed-a2fd004adb29 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.647058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165393cd-1d2f-4eb1-87ed-a2fd004adb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.673678 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-165393cd-1d2f-4eb1-87ed-a2fd004adb29 None None] MFA Rules not processed for user `4f680a4dc0b0413cb8c33de2c7e3653b`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:19.674908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-165393cd-1d2f-4eb1-87ed-a2fd004adb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:19.743792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1224/2445] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:19.755034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.756740 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:19.811856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34c04-19f1-40a0-943e-92fc97798936 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.815873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.816512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.816795 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.817065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.826725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.828143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:19.837979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1222/2446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:19.912674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165393cd-1d2f-4eb1-87ed-a2fd004adb29 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:19.922332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165393cd-1d2f-4eb1-87ed-a2fd004adb29 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:19.926396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cbeec-0b93-4acf-b7db-a447e92985d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:19.927053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cbeec-0b93-4acf-b7db-a447e92985d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:19.927333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cbeec-0b93-4acf-b7db-a447e92985d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:19.927603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cbeec-0b93-4acf-b7db-a447e92985d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:19.984452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cbeec-0b93-4acf-b7db-a447e92985d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:19.986420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cbeec-0b93-4acf-b7db-a447e92985d9 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:20.000459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1225/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:19 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:20.933891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:20.935602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:20.947572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71314b4-27ca-481a-bcda-4604221dab05 service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:20.952008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:20.952668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:20.952920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:20.953218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:20.955725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:21.018618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:21.020068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:21.029440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1223/2448] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:31.591187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:31.592126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:31.592404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:31.612482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] MFA Rules not processed for user `6b9b3d707b264422aa36e0d86757ca2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:31.613877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:31.747501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1226/2449] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:32.048916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:32.050456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:32.147651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfbe69-1cf1-40fe-852f-966f4783fb8d service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:32.152138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:32.154283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:32.154283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:32.154283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:32.155153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:32.245099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:32.246586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:32.256394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1224/2450] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:32.316897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:32.318492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:32.333200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b50c1-130a-42ef-add5-cdd7b74b838f None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:32.337623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:32.338315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:32.339029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:32.339029 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:32.340921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:32.351004 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:32.352445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:32.360598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1227/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:36.121517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:36.123293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:36.136314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79581420-c27e-4ee8-adbc-bd3d686c282d service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:36.153779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:36.154844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:36.155134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:36.155411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] PATH_INFO: `/v3/users/6bac7b20bdb348c09f0dd59abb7ae08b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:36.156823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bac7b20bdb348c09f0dd59abb7ae08b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:36.158894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:36.211997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bac7b20bdb348c09f0dd59abb7ae08b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.219053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bac7b20bdb348c09f0dd59abb7ae08b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.219727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bac7b20bdb348c09f0dd59abb7ae08b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.220327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bac7b20bdb348c09f0dd59abb7ae08b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.232923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d036d5c3-5751-4dda-8a9e-57d162d40b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bac7b20bdb348c09f0dd59abb7ae08b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.250714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1225/2452] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:36 2022] DELETE /identity/v3/users/6bac7b20bdb348c09f0dd59abb7ae08b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:36.602898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:36.626916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417843-9ed0-4c13-863f-c9610c147417 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:36.761430 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:36.762382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:36.762908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:36.763027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] PATH_INFO: `/v3/projects/335b33f41cb34e258ebd47a0bd128982` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:36.764952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=335b33f41cb34e258ebd47a0bd128982)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:36.767666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:36.834534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335b33f41cb34e258ebd47a0bd128982', 'request_id': 'req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.846009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335b33f41cb34e258ebd47a0bd128982', 'request_id': 'req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.854487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335b33f41cb34e258ebd47a0bd128982', 'request_id': 'req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.876060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] The token cache is being invalidate because project 335b33f41cb34e258ebd47a0bd128982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:36.876556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.877677 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9d3ba7bf-c00f-48f3-b3cc-8763e5e3a02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:36.880422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1228/2453] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:36 2022] DELETE /identity/v3/projects/335b33f41cb34e258ebd47a0bd128982 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:36.885374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c35-6752-4ebf-87bd-581a710d925a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:36.885854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c35-6752-4ebf-87bd-581a710d925a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:36.886342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff9c35-6752-4ebf-87bd-581a710d925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:36.931254 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-81ff9c35-6752-4ebf-87bd-581a710d925a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:36.932737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-81ff9c35-6752-4ebf-87bd-581a710d925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:37.036119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1226/2454] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:37.038924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251607-377f-48d6-aec5-5097f1b6cd09 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.039565 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251607-377f-48d6-aec5-5097f1b6cd09 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.040080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2251607-377f-48d6-aec5-5097f1b6cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.074826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c2251607-377f-48d6-aec5-5097f1b6cd09 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:37.076047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c2251607-377f-48d6-aec5-5097f1b6cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:37.085722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1229/2455] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:37.090282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9c35-6752-4ebf-87bd-581a710d925a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:37.105185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff9c35-6752-4ebf-87bd-581a710d925a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:37.110825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:37.111781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.112022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.112294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.113098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:37.113441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:37.115381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:37.128415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1227/2456] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:00:37.132875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2251607-377f-48d6-aec5-5097f1b6cd09 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:37.142372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2251607-377f-48d6-aec5-5097f1b6cd09 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:37.147015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:37.147759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.148075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.148352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.149075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:37.151012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:37.181346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1230/2457] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:37 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:37.185765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:37.195737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c7a81-acdb-405f-9e0d-715d76197c9c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:37.251851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:37.252587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.252993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.253179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.253835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:37.256199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:37.277417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1228/2458] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:37 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:37.281556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:37.292616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e73a8b-16c2-4fcb-b5f0-350f8ad125b5 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:37.297928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:37.298656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.298945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.299220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.299957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:37.305116 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:37.318777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1231/2459] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:37.322695 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:37.333536 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c465d87-2abe-4068-9d6e-5e4de8a1b93c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:37.347939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a156d05-6d2c-4eb9-9fea-9e5d60b523e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:37.348797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156d05-6d2c-4eb9-9fea-9e5d60b523e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.349178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156d05-6d2c-4eb9-9fea-9e5d60b523e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.349685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156d05-6d2c-4eb9-9fea-9e5d60b523e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.350550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a156d05-6d2c-4eb9-9fea-9e5d60b523e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:37.352266 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a156d05-6d2c-4eb9-9fea-9e5d60b523e7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:37.363191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1229/2460] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:37.367840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:37.378119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccbfdc-a238-4854-90ba-93ec1063961d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:37.383575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:37.384674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.385893 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.386274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] PATH_INFO: `/v3/projects/6eb3e72028624331a76c6a9b87b9ee63/users/efbfee5b64c9416b939c92ef28b36746/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.403464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb3e72028624331a76c6a9b87b9ee63, user_id=efbfee5b64c9416b939c92ef28b36746, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:37.406342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:37.425359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1232/2461] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:37 2022] PUT /identity/v3/projects/6eb3e72028624331a76c6a9b87b9ee63/users/efbfee5b64c9416b939c92ef28b36746/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:37.435706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321557-076a-42de-9e28-ca84331f1b6a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.436206 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321557-076a-42de-9e28-ca84331f1b6a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.436651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42321557-076a-42de-9e28-ca84331f1b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.470716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-42321557-076a-42de-9e28-ca84331f1b6a None None] MFA Rules not processed for user `efbfee5b64c9416b939c92ef28b36746`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:37.472221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-42321557-076a-42de-9e28-ca84331f1b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:37.552721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1230/2462] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:37.560143 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:37.562845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:37.657141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f2dd-c0aa-474c-83ea-f2fb75d13a14 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:37.663069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fe08-e035-44dc-b7b8-a13c91525e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:37.663953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fe08-e035-44dc-b7b8-a13c91525e71 service nova] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:37.664296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fe08-e035-44dc-b7b8-a13c91525e71 service nova] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:37.664659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fe08-e035-44dc-b7b8-a13c91525e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:37.673479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0fe08-e035-44dc-b7b8-a13c91525e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:37.675308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0fe08-e035-44dc-b7b8-a13c91525e71 service nova] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:37.685846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1233/2463] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:41.411954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42321557-076a-42de-9e28-ca84331f1b6a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:41.477778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42321557-076a-42de-9e28-ca84331f1b6a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:41.482696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:41.483567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:41.483836 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:41.484101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] PATH_INFO: `/v3/users/efbfee5b64c9416b939c92ef28b36746` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:41.485299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efbfee5b64c9416b939c92ef28b36746)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:41.487281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:41.532061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efbfee5b64c9416b939c92ef28b36746'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:41.538496 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efbfee5b64c9416b939c92ef28b36746'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:41.539137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efbfee5b64c9416b939c92ef28b36746'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:41.539773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efbfee5b64c9416b939c92ef28b36746'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:41.552307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efbfee5b64c9416b939c92ef28b36746'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:41.566654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1231/2464] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:41 2022] DELETE /identity/v3/users/efbfee5b64c9416b939c92ef28b36746 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:41.572165 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed126914-c46f-4110-b906-a5554559a961 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:41.572637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed126914-c46f-4110-b906-a5554559a961 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:41.572816 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed126914-c46f-4110-b906-a5554559a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:41.589952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ed126914-c46f-4110-b906-a5554559a961 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:41.591168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ed126914-c46f-4110-b906-a5554559a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:41.650109 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1234/2465] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:41.656593 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:41.658180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:41.717389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a630-8c04-4ffb-862a-f2e97e6e9bf2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:41.722819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:41.723512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:41.723956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:41.724149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:41.736053 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:41.737564 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:41.748029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1232/2466] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:41.964028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed126914-c46f-4110-b906-a5554559a961 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:41.965628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ed126914-c46f-4110-b906-a5554559a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:41.977714 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed126914-c46f-4110-b906-a5554559a961 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:41.982519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:41.983384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:41.983667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:41.984049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] PATH_INFO: `/v3/users/d17f255b832f44379ebbc6bb29e6cb2d` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:41.985245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17f255b832f44379ebbc6bb29e6cb2d)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:41.987213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.023125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.024842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.037450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17f255b832f44379ebbc6bb29e6cb2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.047837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fd9b5-38e9-495d-9d33-0fd8576f0f14 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.049288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17f255b832f44379ebbc6bb29e6cb2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.056413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17f255b832f44379ebbc6bb29e6cb2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.060680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.061633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.061920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.062276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] PATH_INFO: `/v3/projects/6eb3e72028624331a76c6a9b87b9ee63` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.063474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb3e72028624331a76c6a9b87b9ee63)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.065296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17f255b832f44379ebbc6bb29e6cb2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.065639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.065955 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-3da2e92e-044b-42d6-994b-258dd22f1899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17f255b832f44379ebbc6bb29e6cb2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.074662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1235/2467] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:41 2022] DELETE /identity/v3/users/d17f255b832f44379ebbc6bb29e6cb2d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:42.079971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.080303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.080669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.098934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:42.101083 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.118389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb3e72028624331a76c6a9b87b9ee63', 'request_id': 'req-78b9b334-c689-4ea7-b489-56f8690d5d3c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.127878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb3e72028624331a76c6a9b87b9ee63', 'request_id': 'req-78b9b334-c689-4ea7-b489-56f8690d5d3c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.134258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb3e72028624331a76c6a9b87b9ee63', 'request_id': 'req-78b9b334-c689-4ea7-b489-56f8690d5d3c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.146042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] The token cache is being invalidate because project 6eb3e72028624331a76c6a9b87b9ee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:42.146637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.147495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-78b9b334-c689-4ea7-b489-56f8690d5d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.149174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1233/2468] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:42 2022] DELETE /identity/v3/projects/6eb3e72028624331a76c6a9b87b9ee63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:42.154180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a285a28-a95c-4f47-8bee-6467f0fd8b12 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.154583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a285a28-a95c-4f47-8bee-6467f0fd8b12 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.154953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a285a28-a95c-4f47-8bee-6467f0fd8b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.164795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1236/2469] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:42.174682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2a285a28-a95c-4f47-8bee-6467f0fd8b12 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:42.175926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2a285a28-a95c-4f47-8bee-6467f0fd8b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.176265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.177909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.236387 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4b91-4c6f-4438-9253-8343ca336eb7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.246777 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1234/2470] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:42.248558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20229d5-0ac2-4234-b059-ef9c73714e29 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.248850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20229d5-0ac2-4234-b059-ef9c73714e29 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.249123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20229d5-0ac2-4234-b059-ef9c73714e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.268028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a20229d5-0ac2-4234-b059-ef9c73714e29 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:42.269325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a20229d5-0ac2-4234-b059-ef9c73714e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.277633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1235/2471] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:42.281778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20229d5-0ac2-4234-b059-ef9c73714e29 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.287952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.288702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.289027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.289368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.290880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20229d5-0ac2-4234-b059-ef9c73714e29 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.295657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.296332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.297219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.297219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.297609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:42.297913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.299322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.299558 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.300784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.311183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1237/2472] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:42.315493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1236/2473] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:00:42.319871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.331608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69297-76c2-4a4c-a592-2c7ffd5e7f93 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.337177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.338226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.338649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.339181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.339942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.341958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.374701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1238/2474] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:42 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:42.378898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.390861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06459-e4e8-4ea7-a097-9a2f8233cc75 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.459220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.459965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.460305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.460639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.461445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.464435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.502360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1237/2475] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:42 2022] POST /identity/v3/users => generated 282 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:42.503610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.515096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09324cd-6357-4f84-9f8d-c2b605a27238 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.522817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.523501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.523824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.524102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.525082 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.526720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.544732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1239/2476] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:42.549041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.560007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f20976-7d11-4898-bc8c-e0234bf76528 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.566061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.566867 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.567222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.567576 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.568984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.571247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.584741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1238/2477] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:42.589119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.599356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817cebf-7cb1-483c-87b8-943ca586c9d9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.604023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427e705-0851-426c-912b-f6bfc5344fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.604936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427e705-0851-426c-912b-f6bfc5344fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.605235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427e705-0851-426c-912b-f6bfc5344fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.605480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427e705-0851-426c-912b-f6bfc5344fc0 admin admin] PATH_INFO: `/v3/projects/7357ebe3f890479387322ac739a4e3fc/users/44edf5e9aa564829bf2a4dc75a2725c8/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.619106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.620953 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.621661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427e705-0851-426c-912b-f6bfc5344fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7357ebe3f890479387322ac739a4e3fc, user_id=44edf5e9aa564829bf2a4dc75a2725c8, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.624761 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427e705-0851-426c-912b-f6bfc5344fc0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.635021 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e579e-8565-4c77-a9cf-e5d8cdb4f82f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.644388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1240/2478] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:42 2022] PUT /identity/v3/projects/7357ebe3f890479387322ac739a4e3fc/users/44edf5e9aa564829bf2a4dc75a2725c8/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:42.655370 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.655662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.655938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.681577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] MFA Rules not processed for user `44edf5e9aa564829bf2a4dc75a2725c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:42.682858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.696495 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.697482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.697831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.698207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] PATH_INFO: `/v3/projects/d213695c65664b1590897bd5879a97ed` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.699400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d213695c65664b1590897bd5879a97ed)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.701499 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.746878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1241/2479] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:42.749467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd213695c65664b1590897bd5879a97ed', 'request_id': 'req-4857cec8-71ba-4120-9def-ee05a3525d7c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.758450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd213695c65664b1590897bd5879a97ed', 'request_id': 'req-4857cec8-71ba-4120-9def-ee05a3525d7c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.759028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.760644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.764600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd213695c65664b1590897bd5879a97ed', 'request_id': 'req-4857cec8-71ba-4120-9def-ee05a3525d7c'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.775856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] The token cache is being invalidate because project d213695c65664b1590897bd5879a97ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:42.776151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.776816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.779204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1239/2480] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:42 2022] DELETE /identity/v3/projects/d213695c65664b1590897bd5879a97ed => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:42.783575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:42.784971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.817023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e622da-8b60-4744-a257-db1d44c0ba00 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.848424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857cec8-71ba-4120-9def-ee05a3525d7c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:42.853533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.854458 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.854851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.855134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] PATH_INFO: `/v3/users/4f680a4dc0b0413cb8c33de2c7e3653b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.856347 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f680a4dc0b0413cb8c33de2c7e3653b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.859648 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.870572 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944281f-831e-480b-8ef3-8e5cf7261669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:42.871276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944281f-831e-480b-8ef3-8e5cf7261669 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:42.871762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944281f-831e-480b-8ef3-8e5cf7261669 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:42.872061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944281f-831e-480b-8ef3-8e5cf7261669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:42.874173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1944281f-831e-480b-8ef3-8e5cf7261669 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:42.913051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f680a4dc0b0413cb8c33de2c7e3653b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.920404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f680a4dc0b0413cb8c33de2c7e3653b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.921123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f680a4dc0b0413cb8c33de2c7e3653b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.921790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f680a4dc0b0413cb8c33de2c7e3653b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.934315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f680a4dc0b0413cb8c33de2c7e3653b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:42.940744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944281f-831e-480b-8ef3-8e5cf7261669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:42.942349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944281f-831e-480b-8ef3-8e5cf7261669 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:42.950035 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1240/2481] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:42 2022] DELETE /identity/v3/users/4f680a4dc0b0413cb8c33de2c7e3653b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:42.961573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1242/2482] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:43.239395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.241142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.314700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a632-cb53-4b89-961e-fb787989cccd admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.319284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.320155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.320461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.320741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] PATH_INFO: `/v3/projects/3bc569d3f0bd4316816ecc5c897fe950` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.321932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc569d3f0bd4316816ecc5c897fe950)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.323892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.377402 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc569d3f0bd4316816ecc5c897fe950', 'request_id': 'req-407c44c2-bbbc-4001-99d2-807a4b860708'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.388173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc569d3f0bd4316816ecc5c897fe950', 'request_id': 'req-407c44c2-bbbc-4001-99d2-807a4b860708'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.397180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc569d3f0bd4316816ecc5c897fe950', 'request_id': 'req-407c44c2-bbbc-4001-99d2-807a4b860708'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.408891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] The token cache is being invalidate because project 3bc569d3f0bd4316816ecc5c897fe950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:43.409176 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.409869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-407c44c2-bbbc-4001-99d2-807a4b860708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.411439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1241/2483] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:43 2022] DELETE /identity/v3/projects/3bc569d3f0bd4316816ecc5c897fe950 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:43.416532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299039-de01-4cd2-aa3f-aaa33df33631 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.416812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299039-de01-4cd2-aa3f-aaa33df33631 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.417084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83299039-de01-4cd2-aa3f-aaa33df33631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.434682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-83299039-de01-4cd2-aa3f-aaa33df33631 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:43.435860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-83299039-de01-4cd2-aa3f-aaa33df33631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.494759 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1243/2484] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:43.503945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc25972-32ea-4e86-b0e3-ea764875cc73 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.504502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc25972-32ea-4e86-b0e3-ea764875cc73 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.504502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc25972-32ea-4e86-b0e3-ea764875cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.522488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-7bc25972-32ea-4e86-b0e3-ea764875cc73 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:43.523716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7bc25972-32ea-4e86-b0e3-ea764875cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.532853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1242/2485] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:43.537410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83299039-de01-4cd2-aa3f-aaa33df33631 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.547413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83299039-de01-4cd2-aa3f-aaa33df33631 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.552453 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.553113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.553395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.553671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.554473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:43.554767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.556441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.568456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1244/2486] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:00:43.573120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc25972-32ea-4e86-b0e3-ea764875cc73 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.582983 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc25972-32ea-4e86-b0e3-ea764875cc73 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.587723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.588378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.588663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.588943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.589651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.591970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.618366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.620259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.628937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1243/2487] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:43 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:43.633079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.637801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbe561-3984-4eb7-b778-81aa1868a935 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.700438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.701351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.701606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.702002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] PATH_INFO: `/v3/users/49f74c46eaf94fcfa906ca6eea716bb4` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.703235 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f74c46eaf94fcfa906ca6eea716bb4)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.705516 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.709997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eec208-c0f3-4fe2-9c44-ee78fb0ebeb8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.715377 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.716051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.716336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.716611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.717314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.719258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.743204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1244/2488] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:43 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:43.747281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.755284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f74c46eaf94fcfa906ca6eea716bb4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.757780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365f1-55f7-4d1f-bdf4-6885dac603dc admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.763351 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.763992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.764273 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.764543 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.765265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.766934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.767449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f74c46eaf94fcfa906ca6eea716bb4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.774398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f74c46eaf94fcfa906ca6eea716bb4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.776954 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1245/2489] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:43.781036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.782312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f74c46eaf94fcfa906ca6eea716bb4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.782977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b8f9a42-8e34-4f3e-bfaa-34651c810dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f74c46eaf94fcfa906ca6eea716bb4'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:43.789087 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1245/2490] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:43 2022] DELETE /identity/v3/users/49f74c46eaf94fcfa906ca6eea716bb4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:43.791233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f08b6-d864-4f8d-bd51-ec774b3644b8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.793356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.793733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.794065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.810441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:43.811620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.847156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.847826 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.848110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.848382 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.849106 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.850789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.864449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1246/2491] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:43.868341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.870517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.871246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1246/2492] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:43.880966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:43.882259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.883693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ac3c6-7094-4b65-98a9-76c55b7f3d36 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.888734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ce27-2d5d-4d52-b2a5-9235f99a2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.889631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ce27-2d5d-4d52-b2a5-9235f99a2c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.889905 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ce27-2d5d-4d52-b2a5-9235f99a2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.890205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ce27-2d5d-4d52-b2a5-9235f99a2c85 admin admin] PATH_INFO: `/v3/projects/f4ce7735072a46d8bd736331e50ac6b3/users/4f45764be7ad4aa9a125aa8fd8cd1de2/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.905659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27ce27-2d5d-4d52-b2a5-9235f99a2c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ce7735072a46d8bd736331e50ac6b3, user_id=4f45764be7ad4aa9a125aa8fd8cd1de2, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:43.908319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27ce27-2d5d-4d52-b2a5-9235f99a2c85 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:43.921647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1247/2493] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:43 2022] PUT /identity/v3/projects/f4ce7735072a46d8bd736331e50ac6b3/users/4f45764be7ad4aa9a125aa8fd8cd1de2/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:43.932185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad942536-105a-484a-9462-ffd4ea162466 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.932485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad942536-105a-484a-9462-ffd4ea162466 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.932757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad942536-105a-484a-9462-ffd4ea162466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:43.941176 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1632e94-9c13-454c-9156-1d0f7acbbb1b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:43.958054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-ad942536-105a-484a-9462-ffd4ea162466 None None] MFA Rules not processed for user `4f45764be7ad4aa9a125aa8fd8cd1de2`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:43.959271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-ad942536-105a-484a-9462-ffd4ea162466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:43.987755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:43.988405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:43.988675 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:43.988950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.020821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1248/2494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:44.025523 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad942536-105a-484a-9462-ffd4ea162466 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.049006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.051209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.062758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1247/2495] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:44.088851 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad942536-105a-484a-9462-ffd4ea162466 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.093340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.093998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.094308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.094587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.095281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.097197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.127103 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1249/2496] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:44 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:44.130939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.141049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d68cd3-98be-4962-a716-f3f0dd51e361 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.201145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.201825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.202137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.202418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.203127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.205361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.226335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1248/2497] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:44 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:44.230321 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.240404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a34239-e49d-4152-af3c-456dcf63be29 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.245639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.246381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.247197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.247197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.247817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.249612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.285073 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1250/2498] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:44.288783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.301480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3ed3-d0db-4486-b59a-1b78acf92d58 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.316457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.319000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.319554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.320023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] PATH_INFO: `/v3/projects/ba214a7512f6481faaefc474d9fbb420/users/4475230707ba4fd099486deeb14fa2bd/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.338270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba214a7512f6481faaefc474d9fbb420, user_id=4475230707ba4fd099486deeb14fa2bd, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.342130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.362857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1249/2499] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:44 2022] PUT /identity/v3/projects/ba214a7512f6481faaefc474d9fbb420/users/4475230707ba4fd099486deeb14fa2bd/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:44.364141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.375572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848cfb-8af5-444d-9970-bbf0e2bea62c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.443803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.444813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.445656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.445795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:44.446259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.446631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.447548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.450026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.469888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1251/2500] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:44.470926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.481869 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fde30-5b77-4ec2-a174-caac1b938104 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.482420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc9a32-0200-4c5a-b308-e032030eeb75 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.489126 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0c76f-a65d-4bf9-b2f5-354b96937ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.490154 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0c76f-a65d-4bf9-b2f5-354b96937ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.490440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0c76f-a65d-4bf9-b2f5-354b96937ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.490712 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0c76f-a65d-4bf9-b2f5-354b96937ca8 admin admin] PATH_INFO: `/v3/projects/ba214a7512f6481faaefc474d9fbb420/users/4475230707ba4fd099486deeb14fa2bd/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.492801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0c76f-a65d-4bf9-b2f5-354b96937ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba214a7512f6481faaefc474d9fbb420, user_id=4475230707ba4fd099486deeb14fa2bd, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.495906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0c76f-a65d-4bf9-b2f5-354b96937ca8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.497953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.498875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.499153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.499685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] PATH_INFO: `/v3/projects/f27bbe729dff46489f1b2c7ac7d54855` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.501446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27bbe729dff46489f1b2c7ac7d54855)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.502838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.508032 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1252/2501] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:44 2022] PUT /identity/v3/projects/ba214a7512f6481faaefc474d9fbb420/users/4475230707ba4fd099486deeb14fa2bd/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:44.518212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.518591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.519074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.554484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] MFA Rules not processed for user `4475230707ba4fd099486deeb14fa2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:44.556058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:44.559151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27bbe729dff46489f1b2c7ac7d54855', 'request_id': 'req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.567839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27bbe729dff46489f1b2c7ac7d54855', 'request_id': 'req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.574214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27bbe729dff46489f1b2c7ac7d54855', 'request_id': 'req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.590346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] The token cache is being invalidate because project f27bbe729dff46489f1b2c7ac7d54855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:44.591296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.592033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.593813 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1250/2502] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:44 2022] DELETE /identity/v3/projects/f27bbe729dff46489f1b2c7ac7d54855 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:44.597720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.599267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:44.651416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1253/2503] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:44.664699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.666835 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:44.670517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6f2e0-1753-4dd9-b371-8b4d04fbd143 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.677075 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.678954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.679150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.679416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] PATH_INFO: `/v3/users/b24a1c6991fa4968b324d3bf9174c5ce` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.681247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24a1c6991fa4968b324d3bf9174c5ce)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.696921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.755852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6bce6-dd3b-49a4-bc92-f66c555d25f3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.760274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.761015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.761571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.761970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.773773 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.775592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.784326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24a1c6991fa4968b324d3bf9174c5ce'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.787201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1254/2504] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:44.805635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24a1c6991fa4968b324d3bf9174c5ce'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.817878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:44.818423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24a1c6991fa4968b324d3bf9174c5ce'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.819673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:44.830051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24a1c6991fa4968b324d3bf9174c5ce'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.830931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-be9e29de-3fc3-4996-8e20-7cc97aab90f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24a1c6991fa4968b324d3bf9174c5ce'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.837135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521d54e-5aee-4bdc-b01d-3c072361e3a4 service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:44.837817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1251/2505] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:44 2022] DELETE /identity/v3/users/b24a1c6991fa4968b324d3bf9174c5ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:44.909703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:44.910675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:44.911108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:44.911550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] PATH_INFO: `/v3/users/4f45764be7ad4aa9a125aa8fd8cd1de2` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:44.913093 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f45764be7ad4aa9a125aa8fd8cd1de2)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:44.915104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:44.962399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f45764be7ad4aa9a125aa8fd8cd1de2'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.969161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f45764be7ad4aa9a125aa8fd8cd1de2'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.969979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f45764be7ad4aa9a125aa8fd8cd1de2'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.970675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f45764be7ad4aa9a125aa8fd8cd1de2'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.983966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f45764be7ad4aa9a125aa8fd8cd1de2'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:44.998809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1255/2506] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:44 2022] DELETE /identity/v3/users/4f45764be7ad4aa9a125aa8fd8cd1de2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:45.003316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.003641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.007808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.020957 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:45.022184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.084357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1252/2507] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:45.094242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.095670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.122886 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.124506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.142177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce59b0-f754-4673-be52-e1921f3eeefd None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.152362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.153368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.153652 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.153925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] PATH_INFO: `/v3/projects/95388f13b72e4c418bc44d31e9961cb2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.155353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95388f13b72e4c418bc44d31e9961cb2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.157308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.168959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b6f8e-6fbc-4716-a87e-7ebaaee855a7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.172743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12b3c8-5113-44a8-be34-4a9e7ae1de55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.173388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12b3c8-5113-44a8-be34-4a9e7ae1de55 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.173796 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12b3c8-5113-44a8-be34-4a9e7ae1de55 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.173934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12b3c8-5113-44a8-be34-4a9e7ae1de55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.183055 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12b3c8-5113-44a8-be34-4a9e7ae1de55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.186076 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12b3c8-5113-44a8-be34-4a9e7ae1de55 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.200113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1256/2508] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:45.208717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95388f13b72e4c418bc44d31e9961cb2', 'request_id': 'req-d36db100-cd72-4f40-b461-a59447d330c1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.217118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95388f13b72e4c418bc44d31e9961cb2', 'request_id': 'req-d36db100-cd72-4f40-b461-a59447d330c1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.222589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95388f13b72e4c418bc44d31e9961cb2', 'request_id': 'req-d36db100-cd72-4f40-b461-a59447d330c1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.233377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] The token cache is being invalidate because project 95388f13b72e4c418bc44d31e9961cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:45.233659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.234336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-d36db100-cd72-4f40-b461-a59447d330c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.235875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1253/2509] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:45 2022] DELETE /identity/v3/projects/95388f13b72e4c418bc44d31e9961cb2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:45.241449 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea96b4-e1bf-43b6-b3cc-12810779efb8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.241743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea96b4-e1bf-43b6-b3cc-12810779efb8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.242022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea96b4-e1bf-43b6-b3cc-12810779efb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.262636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b4ea96b4-e1bf-43b6-b3cc-12810779efb8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:45.264354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b4ea96b4-e1bf-43b6-b3cc-12810779efb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.331295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1257/2510] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:45.338245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255442c0-913b-4e7b-9ee4-e5a3bb81994b None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.338451 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255442c0-913b-4e7b-9ee4-e5a3bb81994b None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.338727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255442c0-913b-4e7b-9ee4-e5a3bb81994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.369938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-255442c0-913b-4e7b-9ee4-e5a3bb81994b None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:45.371297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-255442c0-913b-4e7b-9ee4-e5a3bb81994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.380589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1254/2511] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:45.384880 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea96b4-e1bf-43b6-b3cc-12810779efb8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.395900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea96b4-e1bf-43b6-b3cc-12810779efb8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.401916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.402612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.402897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.403174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.403910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:45.404218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.405887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.419123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1258/2512] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:00:45.423125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255442c0-913b-4e7b-9ee4-e5a3bb81994b None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.432898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255442c0-913b-4e7b-9ee4-e5a3bb81994b None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.437894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.438928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.438928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.439155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.439802 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.441724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.471304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1255/2513] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:45 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:45.475837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.493693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758a5ae-542c-472a-982d-85bf5e917883 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.521737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.523698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.556008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.556725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.557006 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.557276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.557996 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.560008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.587127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1259/2514] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:45 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:45.588921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.591119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dbf9b-fa79-4ca3-911e-07eaa891a328 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.596005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.596862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.597138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.597408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] PATH_INFO: `/v3/projects/f4ce7735072a46d8bd736331e50ac6b3` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.598581 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d148c-e8ff-465d-81bb-9a18615c11b9 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.598717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ce7735072a46d8bd736331e50ac6b3)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.600586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.603207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.603904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.604185 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.604454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.605184 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.606894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.616862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1260/2515] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:45.620900 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.631044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd109-bda1-49c0-aab1-7c4d2e910e39 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.636164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.636811 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.637089 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.637365 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.638113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.639709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.650264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ce7735072a46d8bd736331e50ac6b3', 'request_id': 'req-0962b181-2fe0-42f4-84c7-a8d1db9213f1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.651622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1261/2516] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:45.655438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.659998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ce7735072a46d8bd736331e50ac6b3', 'request_id': 'req-0962b181-2fe0-42f4-84c7-a8d1db9213f1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.666188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e54d-309f-4c1e-9723-092766af90fc admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.666417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ce7735072a46d8bd736331e50ac6b3', 'request_id': 'req-0962b181-2fe0-42f4-84c7-a8d1db9213f1'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.677341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] The token cache is being invalidate because project f4ce7735072a46d8bd736331e50ac6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:45.678002 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.678571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.680153 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1256/2517] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:45 2022] DELETE /identity/v3/projects/f4ce7735072a46d8bd736331e50ac6b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:45.684170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.685533 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.736625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d5421-040c-474c-8f09-4340d7a7fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.737520 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d5421-040c-474c-8f09-4340d7a7fa97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.737792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d5421-040c-474c-8f09-4340d7a7fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.738066 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d5421-040c-474c-8f09-4340d7a7fa97 admin admin] PATH_INFO: `/v3/projects/165c5234bdbd414f85ac7e56dbb6fce0/users/d647a2866a9b4f7499b5ecdafd634839/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.748573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962b181-2fe0-42f4-84c7-a8d1db9213f1 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.753438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.754329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.754650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.754922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] PATH_INFO: `/v3/users/4475230707ba4fd099486deeb14fa2bd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.756746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4475230707ba4fd099486deeb14fa2bd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.757768 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d5421-040c-474c-8f09-4340d7a7fa97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165c5234bdbd414f85ac7e56dbb6fce0, user_id=d647a2866a9b4f7499b5ecdafd634839, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.758787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.760923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d5421-040c-474c-8f09-4340d7a7fa97 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:45.775109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1262/2518] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:45 2022] PUT /identity/v3/projects/165c5234bdbd414f85ac7e56dbb6fce0/users/d647a2866a9b4f7499b5ecdafd634839/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:45.785547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0afd4-8a41-47f8-8209-a7f319b64876 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.785683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0afd4-8a41-47f8-8209-a7f319b64876 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.785935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0afd4-8a41-47f8-8209-a7f319b64876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.811794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4475230707ba4fd099486deeb14fa2bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.815284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e9b0afd4-8a41-47f8-8209-a7f319b64876 None None] MFA Rules not processed for user `d647a2866a9b4f7499b5ecdafd634839`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:45.816612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e9b0afd4-8a41-47f8-8209-a7f319b64876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.826505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4475230707ba4fd099486deeb14fa2bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.834473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4475230707ba4fd099486deeb14fa2bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.844249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4475230707ba4fd099486deeb14fa2bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.844921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4475230707ba4fd099486deeb14fa2bd'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:45.851950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1257/2519] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:45 2022] DELETE /identity/v3/users/4475230707ba4fd099486deeb14fa2bd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:45.885059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1263/2520] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:45.889449 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:45.890952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:45.972841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8a7ed-f940-4cec-934f-bfd145ef4eb9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:45.977671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:45.978355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:45.979205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:45.979205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:45.979609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:45.981557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.018129 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1258/2521] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:45 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:46.020599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0afd4-8a41-47f8-8209-a7f319b64876 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.106938 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0afd4-8a41-47f8-8209-a7f319b64876 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.171804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.172526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.172894 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.173227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.173934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.176280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.200725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1264/2522] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:46 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:46.204982 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.220777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373257a-f3a6-47a6-9cd8-d222e202f543 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.225539 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.226255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.226541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.226868 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.227601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.229304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.241215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1259/2523] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:46.245199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.255798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.258832 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.262545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535a01d-047e-4108-9e91-a7dc55c320db admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.268891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.269801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.269991 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.270389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] PATH_INFO: `/v3/projects/dcaf53a0be9c44ae80bb13114e708571/users/be8950b0fae44d37911756f1e6855830/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.276879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9c5b7-e0c0-4d05-8b50-a66b133d08ab admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.282534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.283417 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.283767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.284589 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] PATH_INFO: `/v3/projects/ba214a7512f6481faaefc474d9fbb420` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.285690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba214a7512f6481faaefc474d9fbb420)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.287576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.288613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcaf53a0be9c44ae80bb13114e708571, user_id=be8950b0fae44d37911756f1e6855830, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.291674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.307372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1265/2524] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:46 2022] PUT /identity/v3/projects/dcaf53a0be9c44ae80bb13114e708571/users/be8950b0fae44d37911756f1e6855830/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:46.311332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.342139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba214a7512f6481faaefc474d9fbb420', 'request_id': 'req-6e06f8c0-8394-4455-adb2-2494ed176035'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:46.350427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba214a7512f6481faaefc474d9fbb420', 'request_id': 'req-6e06f8c0-8394-4455-adb2-2494ed176035'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:46.356059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba214a7512f6481faaefc474d9fbb420', 'request_id': 'req-6e06f8c0-8394-4455-adb2-2494ed176035'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:46.366861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] The token cache is being invalidate because project ba214a7512f6481faaefc474d9fbb420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:46.367255 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:46.367988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6e06f8c0-8394-4455-adb2-2494ed176035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:46.369528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1260/2525] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:46 2022] DELETE /identity/v3/projects/ba214a7512f6481faaefc474d9fbb420 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:46.374237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54d0fe-1ef8-42da-97e6-a4b19d3f212a None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.374526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54d0fe-1ef8-42da-97e6-a4b19d3f212a None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.374807 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54d0fe-1ef8-42da-97e6-a4b19d3f212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.376868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621bc19-af75-46c1-9fa9-11a94b8eb927 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.392478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-bb54d0fe-1ef8-42da-97e6-a4b19d3f212a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:46.393684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-bb54d0fe-1ef8-42da-97e6-a4b19d3f212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.434550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.435389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.435789 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.436119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.436968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.439186 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.449120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1266/2526] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:46.452977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.453768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1261/2527] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:46.454970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.462857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15687b-af19-4401-8a21-e32454d1c8d1 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.463144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15687b-af19-4401-8a21-e32454d1c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.463422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15687b-af19-4401-8a21-e32454d1c8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.467201 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fa19-bfd1-4860-9b14-d7825aaac0e1 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.471761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd298308-7271-4a04-b0b8-22146dca50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.472633 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298308-7271-4a04-b0b8-22146dca50e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.472909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298308-7271-4a04-b0b8-22146dca50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.473181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298308-7271-4a04-b0b8-22146dca50e4 admin admin] PATH_INFO: `/v3/projects/dcaf53a0be9c44ae80bb13114e708571/users/be8950b0fae44d37911756f1e6855830/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.475188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298308-7271-4a04-b0b8-22146dca50e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcaf53a0be9c44ae80bb13114e708571, user_id=be8950b0fae44d37911756f1e6855830, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.477864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298308-7271-4a04-b0b8-22146dca50e4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.480848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9c15687b-af19-4401-8a21-e32454d1c8d1 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:46.482062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9c15687b-af19-4401-8a21-e32454d1c8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.487850 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1267/2528] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:46 2022] PUT /identity/v3/projects/dcaf53a0be9c44ae80bb13114e708571/users/be8950b0fae44d37911756f1e6855830/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:46.498775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.499029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.499338 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.527812 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] MFA Rules not processed for user `be8950b0fae44d37911756f1e6855830`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:46.529144 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.544386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1262/2529] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:46.548560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15687b-af19-4401-8a21-e32454d1c8d1 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.557803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15687b-af19-4401-8a21-e32454d1c8d1 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.563107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.563898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.564228 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.564601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.565852 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:46.566796 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.568953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.585540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1263/2530] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:00:46.589956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.605899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd93e43-90cb-4827-88ba-944e280b3598 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.612328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.613238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.613717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.614097 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.614770 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.620057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1268/2531] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:46.620563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.630516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.632123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.648486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1264/2532] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:46 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:46.653086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.693315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc24c6-536a-4342-9f80-f7a6760f5453 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.725700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec531881-2c96-416e-80af-d4c143222a04 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.731502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.732418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.732722 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.733141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.734264 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.737102 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.748453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.749105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.749390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.749676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.761829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1265/2533] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:46 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:46.765913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.776347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4db1a-c66b-4f0d-b6f3-c23f5e421a99 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.780946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.781603 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.781998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.782313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.783069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.784687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.795239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1266/2534] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:46.799110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.808735 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b717959-588e-4ebb-8db1-9eda170ae7a5 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.813502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.814290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.814642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.814988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.815787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.817472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.821138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.822643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.828263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1267/2535] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:46.833266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.834989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1269/2536] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:46.847059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca450f02-3041-4385-854c-98a899206ebd admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.852826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981a8bb-625b-43c6-a26a-7bb168987589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.853837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981a8bb-625b-43c6-a26a-7bb168987589 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.854134 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981a8bb-625b-43c6-a26a-7bb168987589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.854386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981a8bb-625b-43c6-a26a-7bb168987589 admin admin] PATH_INFO: `/v3/projects/79f1ae23147d487db5eba910abeac218/users/3da9948d9365419eb515f8a178518fba/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.877517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981a8bb-625b-43c6-a26a-7bb168987589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f1ae23147d487db5eba910abeac218, user_id=3da9948d9365419eb515f8a178518fba, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:46.880337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981a8bb-625b-43c6-a26a-7bb168987589 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:46.881230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:46.883229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.895215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1268/2537] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:46 2022] PUT /identity/v3/projects/79f1ae23147d487db5eba910abeac218/users/3da9948d9365419eb515f8a178518fba/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:46.904906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fc5fb-98fd-400f-8a6f-b081a2fa1dea service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:46.907307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4583e3-c99c-4d6a-83cb-27e53a79ed11 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.907661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4583e3-c99c-4d6a-83cb-27e53a79ed11 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.907942 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4583e3-c99c-4d6a-83cb-27e53a79ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.937892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-5c4583e3-c99c-4d6a-83cb-27e53a79ed11 None None] MFA Rules not processed for user `3da9948d9365419eb515f8a178518fba`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:46.939250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-5c4583e3-c99c-4d6a-83cb-27e53a79ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:46.958993 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:46.959612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:46.959897 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:46.960192 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:46.962141 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:47.009338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1269/2538] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:47.014216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4583e3-c99c-4d6a-83cb-27e53a79ed11 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.033622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.035620 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.047214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1270/2539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:47.081148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4583e3-c99c-4d6a-83cb-27e53a79ed11 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.086390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.087429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.087429 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.087775 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.088711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.090825 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.126330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1270/2540] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:47 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:47.129612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.141493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1072b5-1dd9-45a0-9cc9-5230b263756b service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.241287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.242164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.242549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.242830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.243539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.248027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.275720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1271/2541] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:47 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:47.279275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.294060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f005-896d-4722-93c3-1bc8ed668230 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.300263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.301122 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.301561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.302011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.302916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.304718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.333867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1271/2542] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:47.335612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.348134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72baa3-68d9-42cf-8d2a-5cf97055fb60 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.353786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.354902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.355255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.355585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] PATH_INFO: `/v3/projects/1e92beb3010c498aab62e4f1aee37959/users/460b1d0d296747d890d1e11e4efaed3e/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.389387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e92beb3010c498aab62e4f1aee37959, user_id=460b1d0d296747d890d1e11e4efaed3e, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.392230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.416602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1272/2543] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:47 2022] PUT /identity/v3/projects/1e92beb3010c498aab62e4f1aee37959/users/460b1d0d296747d890d1e11e4efaed3e/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:47.420463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.431826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5aaa2-6bc0-4817-91fe-17f926991f51 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.491446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04046130-b690-4acc-a44b-2545644689d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.492195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046130-b690-4acc-a44b-2545644689d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.492507 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046130-b690-4acc-a44b-2545644689d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.492793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04046130-b690-4acc-a44b-2545644689d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.493502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04046130-b690-4acc-a44b-2545644689d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.499084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04046130-b690-4acc-a44b-2545644689d8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.511711 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1272/2544] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:47.515667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.525914 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe078-0bf6-447d-b39f-e3e3ce9a9609 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.531484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.532696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.533026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.533415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] PATH_INFO: `/v3/projects/1e92beb3010c498aab62e4f1aee37959/users/460b1d0d296747d890d1e11e4efaed3e/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.540929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e92beb3010c498aab62e4f1aee37959, user_id=460b1d0d296747d890d1e11e4efaed3e, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.545147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.557823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1273/2545] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:47 2022] PUT /identity/v3/projects/1e92beb3010c498aab62e4f1aee37959/users/460b1d0d296747d890d1e11e4efaed3e/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:47.568180 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901977fd-aa2a-4b8a-9dbb-d4371c600a8c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.568574 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901977fd-aa2a-4b8a-9dbb-d4371c600a8c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.568923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901977fd-aa2a-4b8a-9dbb-d4371c600a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.597439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-901977fd-aa2a-4b8a-9dbb-d4371c600a8c None None] MFA Rules not processed for user `460b1d0d296747d890d1e11e4efaed3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:47.599172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-901977fd-aa2a-4b8a-9dbb-d4371c600a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:47.679331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1273/2546] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:47.692331 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.789923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274678-720a-4953-9dca-ccd5073650e4 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.794483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c23d94-47a5-41fd-84fc-f632414f9de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.795162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23d94-47a5-41fd-84fc-f632414f9de3 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.795443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23d94-47a5-41fd-84fc-f632414f9de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.795718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23d94-47a5-41fd-84fc-f632414f9de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.806038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c23d94-47a5-41fd-84fc-f632414f9de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.809394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c23d94-47a5-41fd-84fc-f632414f9de3 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:47.819231 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1274/2547] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:47.909715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901977fd-aa2a-4b8a-9dbb-d4371c600a8c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:47.974546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901977fd-aa2a-4b8a-9dbb-d4371c600a8c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:47.978991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:47.979933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:47.980226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:47.980503 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] PATH_INFO: `/v3/users/3da9948d9365419eb515f8a178518fba` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:47.981687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da9948d9365419eb515f8a178518fba)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:47.983622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:48.028925 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da9948d9365419eb515f8a178518fba'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.040200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da9948d9365419eb515f8a178518fba'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.046997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da9948d9365419eb515f8a178518fba'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.055534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da9948d9365419eb515f8a178518fba'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.056207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da9948d9365419eb515f8a178518fba'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.062174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1274/2548] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:47 2022] DELETE /identity/v3/users/3da9948d9365419eb515f8a178518fba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:48.066670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:48.067127 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:48.067683 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:48.086311 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:48.087508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:48.150258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1275/2549] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:48.159921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:48.161570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:48.221017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097c1a3-5442-4edd-bfd2-69b054c24418 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:48.224724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:48.225307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:48.225584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:48.225854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:48.235242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:48.236595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:48.246001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1275/2550] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:48.528578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:48.531329 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:48.554069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a67d4d-276e-458f-a813-b19fc0586986 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:48.562701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:48.563579 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:48.564040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:48.564319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] PATH_INFO: `/v3/projects/79f1ae23147d487db5eba910abeac218` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:48.565521 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f1ae23147d487db5eba910abeac218)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:48.568424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:48.630120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f1ae23147d487db5eba910abeac218', 'request_id': 'req-571b45b7-5d79-4442-9d21-604f4ea5152b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.638840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f1ae23147d487db5eba910abeac218', 'request_id': 'req-571b45b7-5d79-4442-9d21-604f4ea5152b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.644440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f1ae23147d487db5eba910abeac218', 'request_id': 'req-571b45b7-5d79-4442-9d21-604f4ea5152b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.655230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] The token cache is being invalidate because project 79f1ae23147d487db5eba910abeac218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:48.655519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.656218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.657940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1276/2551] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:48 2022] DELETE /identity/v3/projects/79f1ae23147d487db5eba910abeac218 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:48.661902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:48.671651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bf8f5-d154-4a66-814c-69b9ae80b71f service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:48.731336 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:48.732418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:48.732930 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:48.733296 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] PATH_INFO: `/v3/users/460b1d0d296747d890d1e11e4efaed3e` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:48.735265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460b1d0d296747d890d1e11e4efaed3e)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:48.737372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:48.795740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460b1d0d296747d890d1e11e4efaed3e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.811213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460b1d0d296747d890d1e11e4efaed3e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.818402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460b1d0d296747d890d1e11e4efaed3e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.827171 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460b1d0d296747d890d1e11e4efaed3e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.828666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-9e2afd44-0151-457d-80ab-1cd8c8eaec37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460b1d0d296747d890d1e11e4efaed3e'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:48.836112 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1276/2552] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:48 2022] DELETE /identity/v3/users/460b1d0d296747d890d1e11e4efaed3e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:49.180005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.181806 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:49.198668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b45b7-5d79-4442-9d21-604f4ea5152b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.279132 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.280529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.280818 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.281098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] PATH_INFO: `/v3/projects/1e92beb3010c498aab62e4f1aee37959` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.283228 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e92beb3010c498aab62e4f1aee37959)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:49.287147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:49.335810 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e92beb3010c498aab62e4f1aee37959', 'request_id': 'req-148deb55-48ef-4cab-b338-3e1750c3d7df'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:49.343847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e92beb3010c498aab62e4f1aee37959', 'request_id': 'req-148deb55-48ef-4cab-b338-3e1750c3d7df'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:49.353084 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e92beb3010c498aab62e4f1aee37959', 'request_id': 'req-148deb55-48ef-4cab-b338-3e1750c3d7df'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:49.364592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] The token cache is being invalidate because project 1e92beb3010c498aab62e4f1aee37959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:49.364876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:49.365507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-148deb55-48ef-4cab-b338-3e1750c3d7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:49.367110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1277/2553] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:49 2022] DELETE /identity/v3/projects/1e92beb3010c498aab62e4f1aee37959 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:49.372266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dc2ec-1e92-487c-ac0d-6e01351e92a2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.372746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dc2ec-1e92-487c-ac0d-6e01351e92a2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.372843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dc2ec-1e92-487c-ac0d-6e01351e92a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.390465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-a32dc2ec-1e92-487c-ac0d-6e01351e92a2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:49.391760 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a32dc2ec-1e92-487c-ac0d-6e01351e92a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:49.451400 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1277/2554] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:49.461359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf2abd-52e1-42eb-8b8b-590c10b578c6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.461645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf2abd-52e1-42eb-8b8b-590c10b578c6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.461920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf2abd-52e1-42eb-8b8b-590c10b578c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.483765 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-14bf2abd-52e1-42eb-8b8b-590c10b578c6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:49.485003 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-14bf2abd-52e1-42eb-8b8b-590c10b578c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:49.493846 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1278/2555] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:49.498305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dc2ec-1e92-487c-ac0d-6e01351e92a2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.508160 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dc2ec-1e92-487c-ac0d-6e01351e92a2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.513439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.514111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.514409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.514684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.515410 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:49.515778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:49.517324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:49.529061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1278/2556] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:00:49.533629 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf2abd-52e1-42eb-8b8b-590c10b578c6 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.545549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf2abd-52e1-42eb-8b8b-590c10b578c6 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.552171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.552907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.553191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.553455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.554174 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:49.556247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:49.581930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1279/2557] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:49 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:49.587028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.597170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a5456-7a17-4362-86f3-b6be5fe581c8 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.657785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.658492 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.658771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.659071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.659785 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:49.661687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:49.686570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1279/2558] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:49 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:49.688142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.698906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7973-0cc5-4188-b6e3-17f6f32fc9ca admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.703479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.704797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.705159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.705492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.706464 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:49.708166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:49.719747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1280/2559] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:49.724239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.734877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcc3f9-83ab-490c-a424-09c2255bd9d6 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.739653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf08609-36f9-4ea1-90c1-ad14b07f0a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.740315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08609-36f9-4ea1-90c1-ad14b07f0a74 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.740598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08609-36f9-4ea1-90c1-ad14b07f0a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.740871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08609-36f9-4ea1-90c1-ad14b07f0a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.741608 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf08609-36f9-4ea1-90c1-ad14b07f0a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:49.743297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf08609-36f9-4ea1-90c1-ad14b07f0a74 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:49.753219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1280/2560] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:49.757549 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.767667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bd594-e07b-418d-a9d3-4b4ab1ed0711 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.772699 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.774138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.774618 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.775030 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] PATH_INFO: `/v3/projects/6af3ff3cc6544edcb5e7ae4b9b14bb82/users/e70c3991279842cd86ddd494b1cc7c3b/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.792501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af3ff3cc6544edcb5e7ae4b9b14bb82, user_id=e70c3991279842cd86ddd494b1cc7c3b, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:49.795428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:49.809482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1281/2561] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:49 2022] PUT /identity/v3/projects/6af3ff3cc6544edcb5e7ae4b9b14bb82/users/e70c3991279842cd86ddd494b1cc7c3b/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:49.819715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161ea53-fdcf-4951-98fd-e3473ef05f57 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.820005 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161ea53-fdcf-4951-98fd-e3473ef05f57 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.820311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161ea53-fdcf-4951-98fd-e3473ef05f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.846901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f161ea53-fdcf-4951-98fd-e3473ef05f57 None None] MFA Rules not processed for user `e70c3991279842cd86ddd494b1cc7c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:49.848092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f161ea53-fdcf-4951-98fd-e3473ef05f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:49.924891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1281/2562] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:49.929501 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:49.992502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2734e-651f-4210-997a-0c36fd244a1d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:49.997447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:49.998139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:49.998431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:49.998703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:49.999397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.001272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.027783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1282/2563] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:49 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:50.031901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161ea53-fdcf-4951-98fd-e3473ef05f57 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.043321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161ea53-fdcf-4951-98fd-e3473ef05f57 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.099505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.100173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.100499 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.100834 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.101602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.103772 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.125078 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1282/2564] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:50 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:50.130259 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.141219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22fc0c-786a-4ae3-a6b0-eb1701aacd3e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.146031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.146729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.147010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.147373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.148565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.150610 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.169430 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1283/2565] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:50.170696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.181801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068022d-cf00-4250-9a27-ca331e1f2e79 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.186701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.187910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.188098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.188342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] PATH_INFO: `/v3/projects/3502a0c3be0443b29e70ae41f71397d3/users/483b91c65ac34294b29b2d09b814eb7a/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.210256 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3502a0c3be0443b29e70ae41f71397d3, user_id=483b91c65ac34294b29b2d09b814eb7a, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.214543 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.229254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1283/2566] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:50 2022] PUT /identity/v3/projects/3502a0c3be0443b29e70ae41f71397d3/users/483b91c65ac34294b29b2d09b814eb7a/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:50.233286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.244188 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57cbd7-d278-4f6a-9ce5-699ec38027f7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.319647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9648613-63ef-4506-83b0-966a452ce67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.320462 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648613-63ef-4506-83b0-966a452ce67d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.321109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648613-63ef-4506-83b0-966a452ce67d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.321440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648613-63ef-4506-83b0-966a452ce67d admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.322234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9648613-63ef-4506-83b0-966a452ce67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.325134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9648613-63ef-4506-83b0-966a452ce67d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.336879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1284/2567] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:50.341283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.355636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fb6bf-93b8-4602-a034-d4361398ec11 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.361442 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.363733 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.364223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.364789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] PATH_INFO: `/v3/projects/3502a0c3be0443b29e70ae41f71397d3/users/483b91c65ac34294b29b2d09b814eb7a/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.379437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3502a0c3be0443b29e70ae41f71397d3, user_id=483b91c65ac34294b29b2d09b814eb7a, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.382696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.398377 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1284/2568] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:50 2022] PUT /identity/v3/projects/3502a0c3be0443b29e70ae41f71397d3/users/483b91c65ac34294b29b2d09b814eb7a/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:50.409406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.409822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.409958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.441293 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] MFA Rules not processed for user `483b91c65ac34294b29b2d09b814eb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:50.442585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:50.505193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.507744 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:50.524961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1285/2569] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:50.537779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.539222 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:50.574960 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006eb710-63af-4403-ba93-5fafbcf0cb71 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.579906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.580777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.581060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.581350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] PATH_INFO: `/v3/users/d647a2866a9b4f7499b5ecdafd634839` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.582566 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d647a2866a9b4f7499b5ecdafd634839)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.584484 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.593587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3336a0-f405-416b-bb1e-82301b549f4b None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.597189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2898dd6-5b5e-4d81-a86d-1fe065e5580c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.597854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2898dd6-5b5e-4d81-a86d-1fe065e5580c service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.598169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2898dd6-5b5e-4d81-a86d-1fe065e5580c service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.598443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2898dd6-5b5e-4d81-a86d-1fe065e5580c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.607737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2898dd6-5b5e-4d81-a86d-1fe065e5580c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.609145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2898dd6-5b5e-4d81-a86d-1fe065e5580c service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.618975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1286/2570] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:50.638846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd647a2866a9b4f7499b5ecdafd634839'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:50.648268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd647a2866a9b4f7499b5ecdafd634839'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:50.654894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd647a2866a9b4f7499b5ecdafd634839'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:50.671385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd647a2866a9b4f7499b5ecdafd634839'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:50.672028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd647a2866a9b4f7499b5ecdafd634839'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:50.678061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1285/2571] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:50 2022] DELETE /identity/v3/users/d647a2866a9b4f7499b5ecdafd634839 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:50.682659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.682957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.683238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.701395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:50.702692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:50.717580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.719169 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:50.762757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1287/2572] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:50.772568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:50.774125 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:50.777919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d98f87-2e04-4400-b8b9-894999a5e017 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.782091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.782847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.783135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.783464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.785331 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:50.845325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29f90c-3658-44bf-9856-4b3102b9adf6 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:50.847419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.848976 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.849215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:50.849939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:50.850309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:50.850783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:50.858756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1286/2573] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:50.860737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:50.863157 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:50.877092 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1288/2574] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:51.263555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:51.265379 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:51.294263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ff5d4-1120-440a-a03b-7f0a2adb8015 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:51.301857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:51.302791 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:51.303076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:51.303293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] PATH_INFO: `/v3/projects/165c5234bdbd414f85ac7e56dbb6fce0` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:51.304536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] RBAC: Authorizing `identity:delete_project(project_id=165c5234bdbd414f85ac7e56dbb6fce0)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:51.306763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:51.354937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165c5234bdbd414f85ac7e56dbb6fce0', 'request_id': 'req-21a0d304-8588-413a-9048-f6b0fbf4393c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.363100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165c5234bdbd414f85ac7e56dbb6fce0', 'request_id': 'req-21a0d304-8588-413a-9048-f6b0fbf4393c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.369361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165c5234bdbd414f85ac7e56dbb6fce0', 'request_id': 'req-21a0d304-8588-413a-9048-f6b0fbf4393c'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.381590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] The token cache is being invalidate because project 165c5234bdbd414f85ac7e56dbb6fce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:51.382199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.383023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.384687 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1287/2575] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:51 2022] DELETE /identity/v3/projects/165c5234bdbd414f85ac7e56dbb6fce0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:51.388972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:51.400309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdc6f8-c26d-408f-8aee-28aca4b17c6e service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:51.465544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:51.466733 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:51.466943 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:51.467230 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] PATH_INFO: `/v3/users/be8950b0fae44d37911756f1e6855830` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:51.468433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8950b0fae44d37911756f1e6855830)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:51.470451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:51.527425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8950b0fae44d37911756f1e6855830'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.534561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8950b0fae44d37911756f1e6855830'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.535722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8950b0fae44d37911756f1e6855830'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.536332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8950b0fae44d37911756f1e6855830'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.557801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8cbb4563-3906-433a-b5b0-a4dd859d4430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8950b0fae44d37911756f1e6855830'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.563887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:51.565932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:51.578294 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1289/2576] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:51 2022] DELETE /identity/v3/users/be8950b0fae44d37911756f1e6855830 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:51.584203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0d304-8588-413a-9048-f6b0fbf4393c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:51.640190 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:51.641073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:51.641349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:51.641623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] PATH_INFO: `/v3/users/44edf5e9aa564829bf2a4dc75a2725c8` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:51.642835 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44edf5e9aa564829bf2a4dc75a2725c8)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:51.645423 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:51.691804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44edf5e9aa564829bf2a4dc75a2725c8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.703973 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44edf5e9aa564829bf2a4dc75a2725c8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.711388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44edf5e9aa564829bf2a4dc75a2725c8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.719738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44edf5e9aa564829bf2a4dc75a2725c8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.720458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44edf5e9aa564829bf2a4dc75a2725c8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:51.726830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1288/2577] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:51 2022] DELETE /identity/v3/users/44edf5e9aa564829bf2a4dc75a2725c8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:51.732000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:51.732712 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:51.733171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:51.750577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:51.751786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:51.942821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1290/2578] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:51.952551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:51.954072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.011924 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeaef7-f9d3-415d-a7c6-eb24ed725638 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.015707 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63c055-c611-4551-8acd-17a3a5328a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.016357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63c055-c611-4551-8acd-17a3a5328a65 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.016639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63c055-c611-4551-8acd-17a3a5328a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.016909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63c055-c611-4551-8acd-17a3a5328a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.026394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63c055-c611-4551-8acd-17a3a5328a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.027817 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63c055-c611-4551-8acd-17a3a5328a65 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.037794 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1289/2579] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:52.139381 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.141204 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.154060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bb45-af7e-43aa-91a8-ea0ff8ff14f8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.166488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.167632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.168542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.168988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] PATH_INFO: `/v3/projects/dcaf53a0be9c44ae80bb13114e708571` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.171094 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcaf53a0be9c44ae80bb13114e708571)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.174557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.259373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcaf53a0be9c44ae80bb13114e708571', 'request_id': 'req-0f8fc521-3014-4022-9603-8d1c2bb36172'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.269772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcaf53a0be9c44ae80bb13114e708571', 'request_id': 'req-0f8fc521-3014-4022-9603-8d1c2bb36172'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.277526 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcaf53a0be9c44ae80bb13114e708571', 'request_id': 'req-0f8fc521-3014-4022-9603-8d1c2bb36172'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.291882 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] The token cache is being invalidate because project dcaf53a0be9c44ae80bb13114e708571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:52.292165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.293029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.294929 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1291/2580] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:52 2022] DELETE /identity/v3/projects/dcaf53a0be9c44ae80bb13114e708571 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:52.299745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c55c9-7c09-465f-9c56-842fcc60075c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.301084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c55c9-7c09-465f-9c56-842fcc60075c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.301615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c55c9-7c09-465f-9c56-842fcc60075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.339804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-1f6c55c9-7c09-465f-9c56-842fcc60075c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:52.341274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1f6c55c9-7c09-465f-9c56-842fcc60075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.359109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.360891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.450335 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc521-3014-4022-9603-8d1c2bb36172 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.456361 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.457233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.457511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.457786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] PATH_INFO: `/v3/projects/7357ebe3f890479387322ac739a4e3fc` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.458459 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1290/2581] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:52.463177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7357ebe3f890479387322ac739a4e3fc)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.466578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b728d-a19f-42aa-a2f7-7a3212a56039 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.467010 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b728d-a19f-42aa-a2f7-7a3212a56039 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.467651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.467780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b728d-a19f-42aa-a2f7-7a3212a56039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.490127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-964b728d-a19f-42aa-a2f7-7a3212a56039 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:52.490127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-964b728d-a19f-42aa-a2f7-7a3212a56039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.497860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1291/2582] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:52.502536 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b728d-a19f-42aa-a2f7-7a3212a56039 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.512033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b728d-a19f-42aa-a2f7-7a3212a56039 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.523483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7357ebe3f890479387322ac739a4e3fc', 'request_id': 'req-bf810057-d22c-4882-b273-fab324024f90'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.534590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7357ebe3f890479387322ac739a4e3fc', 'request_id': 'req-bf810057-d22c-4882-b273-fab324024f90'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.542788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7357ebe3f890479387322ac739a4e3fc', 'request_id': 'req-bf810057-d22c-4882-b273-fab324024f90'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.574160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] The token cache is being invalidate because project 7357ebe3f890479387322ac739a4e3fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:52.574594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.575947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bf810057-d22c-4882-b273-fab324024f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:52.577834 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1292/2583] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:52 2022] DELETE /identity/v3/projects/7357ebe3f890479387322ac739a4e3fc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:52.583285 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.584086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.584433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.584641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb8e5-6d8f-433a-870e-138a2836bf91 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.584958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb8e5-6d8f-433a-870e-138a2836bf91 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.585240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cb8e5-6d8f-433a-870e-138a2836bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.585356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.586186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:52.586487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.588382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.609518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-df9cb8e5-6d8f-433a-870e-138a2836bf91 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:52.609694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1292/2584] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:00:52.609799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-df9cb8e5-6d8f-433a-870e-138a2836bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.612936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.616763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.619095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1293/2585] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:52.626986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d84b46-3b93-446d-b1b1-e57d1bfc2d98 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.627397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d84b46-3b93-446d-b1b1-e57d1bfc2d98 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.627747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d84b46-3b93-446d-b1b1-e57d1bfc2d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.634846 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b64e5-455d-4715-923b-5565a81b0513 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.640288 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.640956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.641237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.641509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.642243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.644196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.654706 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-63d84b46-3b93-446d-b1b1-e57d1bfc2d98 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:52.656334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-63d84b46-3b93-446d-b1b1-e57d1bfc2d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:52.670352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1294/2586] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:52.674317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d84b46-3b93-446d-b1b1-e57d1bfc2d98 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.678408 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1293/2587] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:52.682641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.685680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d84b46-3b93-446d-b1b1-e57d1bfc2d98 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.747647 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.748505 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.748872 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.749166 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.750426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:52.750426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.751825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.757644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450389c2-966f-4ca8-89ed-986a5743caec admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.763616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.764932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.764932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.765382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.766323 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.768249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1295/2588] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:00:52.769003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.769665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.779312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8874d1e-eb67-4cf1-83a1-9f4c46943af9 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.785238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.786173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.786317 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.786568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.787268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.789362 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.798058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1294/2589] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:52.802673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.815715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56656d1-5aad-4696-87af-ff598ea65ff6 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.820096 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1296/2590] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:52.821242 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.822237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.822624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.823090 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.823902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.824034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.825824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.837623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1295/2591] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:52.842324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.857881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594bd7-5ed8-4111-936b-dd962eec82d4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.900817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fe357-f8da-4468-be2e-e735db95e19b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.909276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.910005 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.910328 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.910612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.911399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.913483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.933617 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.934490 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.934771 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.935635 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.936372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.937997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.938627 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1297/2592] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:52 2022] POST /identity/v3/users => generated 302 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:52.942261 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.953247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1296/2593] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:52.954773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.958591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879dbb5-ba7c-47d6-be3c-9d39fb5ec3d5 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.965173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c7124-0df1-472c-99d7-7dcec0871759 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.966058 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.966755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.967043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.967319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.968082 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.969678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.970409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d672-a78c-47e0-9215-2321d0065c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:52.971475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d672-a78c-47e0-9215-2321d0065c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:52.971940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d672-a78c-47e0-9215-2321d0065c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:52.972054 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d672-a78c-47e0-9215-2321d0065c5b admin admin] PATH_INFO: `/v3/projects/5ccf0abcb5214c39a33b375f16d5f4ec/users/5e1ed642278642da9f9415ae2d5a2a5b/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:52.980115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1298/2594] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:52.983952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:52.988570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d672-a78c-47e0-9215-2321d0065c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccf0abcb5214c39a33b375f16d5f4ec, user_id=5e1ed642278642da9f9415ae2d5a2a5b, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:52.991348 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d672-a78c-47e0-9215-2321d0065c5b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:52.994182 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d632-16a4-4aef-9a72-eb1afeb51d48 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:52.999479 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:53.000282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.000676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.001040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.001877 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:53.003608 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:53.007073 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1297/2595] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:52 2022] PUT /identity/v3/projects/5ccf0abcb5214c39a33b375f16d5f4ec/users/5e1ed642278642da9f9415ae2d5a2a5b/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:53.012019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.012306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.012581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.015314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1299/2596] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:53.019879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:53.029561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:53.030583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff82a-4fee-4478-ba2b-688833f4ea57 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:53.030824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:53.096259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1298/2597] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:53.099650 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401e613-6aed-400c-b4ec-62369e09294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:53.100704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401e613-6aed-400c-b4ec-62369e09294a admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.101059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401e613-6aed-400c-b4ec-62369e09294a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.101422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401e613-6aed-400c-b4ec-62369e09294a admin admin] PATH_INFO: `/v3/projects/241efd1c476d452c8a6128322fd6a335/users/ca8983e94f344298ba644668c85e9e7f/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.106550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:53.108530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:53.119056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401e613-6aed-400c-b4ec-62369e09294a admin admin] RBAC: Authorizing `identity:create_grant(project_id=241efd1c476d452c8a6128322fd6a335, user_id=ca8983e94f344298ba644668c85e9e7f, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:53.123720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401e613-6aed-400c-b4ec-62369e09294a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:53.137277 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1300/2598] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:53 2022] PUT /identity/v3/projects/241efd1c476d452c8a6128322fd6a335/users/ca8983e94f344298ba644668c85e9e7f/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:53.142276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d95eba-8e8f-411b-bde1-770e4de8ff70 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.142617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d95eba-8e8f-411b-bde1-770e4de8ff70 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.142898 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d95eba-8e8f-411b-bde1-770e4de8ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.160445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-98d95eba-8e8f-411b-bde1-770e4de8ff70 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:53.161575 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-98d95eba-8e8f-411b-bde1-770e4de8ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:53.170986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe058b7b-1aee-4328-b3ca-2647a31010d2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:53.219610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:53.220268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.220569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.220858 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.228896 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1301/2599] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:53.230729 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:53.232155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:53.236247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d95eba-8e8f-411b-bde1-770e4de8ff70 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:53.242413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1299/2600] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:53.246015 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d95eba-8e8f-411b-bde1-770e4de8ff70 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:53.249891 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb147d1-e00e-4e0d-a7d7-8d71f8a6a19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:53.250743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb147d1-e00e-4e0d-a7d7-8d71f8a6a19b service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.251020 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb147d1-e00e-4e0d-a7d7-8d71f8a6a19b service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.251550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb147d1-e00e-4e0d-a7d7-8d71f8a6a19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.262320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb147d1-e00e-4e0d-a7d7-8d71f8a6a19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:53.263920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb147d1-e00e-4e0d-a7d7-8d71f8a6a19b service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:53.274574 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1302/2601] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:00:53.521182 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:53.524072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:53.541293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0aa87-0357-4776-8e30-64f65ab4f8e3 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:53.550606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:53.552939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.553435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.554661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] PATH_INFO: `/v3/users/e70c3991279842cd86ddd494b1cc7c3b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.558159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70c3991279842cd86ddd494b1cc7c3b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:53.563517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:53.661569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70c3991279842cd86ddd494b1cc7c3b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:53.684089 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70c3991279842cd86ddd494b1cc7c3b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:53.703557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70c3991279842cd86ddd494b1cc7c3b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:53.717751 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70c3991279842cd86ddd494b1cc7c3b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:53.718500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70c3991279842cd86ddd494b1cc7c3b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:53.725185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1300/2602] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:53 2022] DELETE /identity/v3/users/e70c3991279842cd86ddd494b1cc7c3b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:53.729940 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700434e-adf9-4569-9d3e-6bcd20669255 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.730525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700434e-adf9-4569-9d3e-6bcd20669255 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.730525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700434e-adf9-4569-9d3e-6bcd20669255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.776007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-9700434e-adf9-4569-9d3e-6bcd20669255 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:53.777545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-9700434e-adf9-4569-9d3e-6bcd20669255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:53.860325 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1303/2603] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:00:53.884726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:53.886324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:53.972582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceff5ad-4a91-438e-af46-907692408992 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:53.977452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd65ca4-efac-4259-91e1-c3d137374f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:53.978730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65ca4-efac-4259-91e1-c3d137374f0a service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:53.979376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65ca4-efac-4259-91e1-c3d137374f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:53.979845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65ca4-efac-4259-91e1-c3d137374f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:53.992666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd65ca4-efac-4259-91e1-c3d137374f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:53.995259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd65ca4-efac-4259-91e1-c3d137374f0a service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:54.008028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1301/2604] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:54.727724 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:54.728275 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:54.728624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:54.776132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:54.776622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:54.776725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:54.794804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] MFA Rules not processed for user `5e1ed642278642da9f9415ae2d5a2a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:54.796274 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:54.809575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] MFA Rules not processed for user `ca8983e94f344298ba644668c85e9e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:54.811028 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:54.896451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1304/2605] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:54.899644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:54.903930 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:54.929693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1302/2606] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:54.929693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:54.929693 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:54.942655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ca4a-e693-4479-85df-96da364fbb56 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:54.944906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac6ce-3586-4d67-b3a1-16cf4870d761 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:54.948522 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:54.949350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:54.949669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:54.949945 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:54.950732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:54.952623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:54.958745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:54.959937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:54.960445 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:54.961040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] PATH_INFO: `/v3/projects/6af3ff3cc6544edcb5e7ae4b9b14bb82` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:54.962698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af3ff3cc6544edcb5e7ae4b9b14bb82)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:54.965207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:54.982383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1303/2607] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:54 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:54.983367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:54.985055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.039604 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af3ff3cc6544edcb5e7ae4b9b14bb82', 'request_id': 'req-8b26f7da-7862-450d-a6c8-7f0241c20a07'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.054265 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af3ff3cc6544edcb5e7ae4b9b14bb82', 'request_id': 'req-8b26f7da-7862-450d-a6c8-7f0241c20a07'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.064580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af3ff3cc6544edcb5e7ae4b9b14bb82', 'request_id': 'req-8b26f7da-7862-450d-a6c8-7f0241c20a07'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.068665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16cdde-f1fd-4bc0-9d1e-b328fbd954d0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.080663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] The token cache is being invalidate because project 6af3ff3cc6544edcb5e7ae4b9b14bb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:55.081232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.082718 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.085453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1305/2608] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:54 2022] DELETE /identity/v3/projects/6af3ff3cc6544edcb5e7ae4b9b14bb82 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:55.086700 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.090143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.158606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.159666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.160107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.160388 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.161271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.163213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.177310 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26f7da-7862-450d-a6c8-7f0241c20a07 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.183152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.183910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.184152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.184411 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.185159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.187046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.194362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1304/2609] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:54 2022] POST /identity/v3/projects => generated 405 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:55.194362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.196684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.208874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1306/2610] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:55 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:55.209686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.211389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.223409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8240-8477-4557-aced-2889d6b951e2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.260784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb5e6-d660-4581-ac91-82b2d002e616 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.265412 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.266362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.266641 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.266913 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] PATH_INFO: `/v3/users/483b91c65ac34294b29b2d09b814eb7a` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.268127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=483b91c65ac34294b29b2d09b814eb7a)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.270059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.276219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.276825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.277108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.277391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.278110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.280001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.302372 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1307/2611] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:55 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:55.303193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.313067 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea9043-623a-48ed-b7c3-c94c0325fd9c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.317738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.317910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483b91c65ac34294b29b2d09b814eb7a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.318410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.318692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.318968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.319701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.321315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.331203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483b91c65ac34294b29b2d09b814eb7a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.331509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1308/2612] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:55.332299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.338750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483b91c65ac34294b29b2d09b814eb7a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.341785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc2da5-fea2-45c7-8cc9-c37c80042687 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.347332 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.347840 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483b91c65ac34294b29b2d09b814eb7a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.347952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.348241 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.348560 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483b91c65ac34294b29b2d09b814eb7a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.348665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.349414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.351060 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.354901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1305/2613] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:55 2022] DELETE /identity/v3/users/483b91c65ac34294b29b2d09b814eb7a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:55.358887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.360421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.365285 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1309/2614] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:55.366674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.368556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.381133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244d2ac-1350-45da-a006-09605fbf5444 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.440467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40176-872d-4def-9985-da76ba58d1cc admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.446186 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.447088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.447369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.447643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] PATH_INFO: `/v3/projects/2d1d6b33b5284b57a6e56dffbcd87b5a/users/dcee798f36254283abac1cd0a4909e20/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.448687 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.449643 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.450025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.450431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] PATH_INFO: `/v3/projects/5d8695192f244568bdaf34f100189c9f/users/74c31948a82a4578b7bc981eec6401ef/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.463245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1d6b33b5284b57a6e56dffbcd87b5a, user_id=dcee798f36254283abac1cd0a4909e20, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.466030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.467769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8695192f244568bdaf34f100189c9f, user_id=74c31948a82a4578b7bc981eec6401ef, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.470679 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.480709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1306/2615] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:55 2022] PUT /identity/v3/projects/2d1d6b33b5284b57a6e56dffbcd87b5a/users/dcee798f36254283abac1cd0a4909e20/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:55.484607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.484762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1310/2616] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:55 2022] PUT /identity/v3/projects/5d8695192f244568bdaf34f100189c9f/users/74c31948a82a4578b7bc981eec6401ef/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:55.488979 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.553327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060ab7a-1322-4f47-b81c-8549eacd1c1c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.558485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.559161 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.559441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.559746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.560475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.562074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.562469 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb10f69-2901-4b77-8867-9a757a730e2c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.567686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.568354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.568635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.568912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.569644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.571408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.573227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1307/2617] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:55.577625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.585594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1311/2618] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:55.589602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.589914 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29cd82-4b39-4f75-9848-fa7750cbccb0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.594851 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.595861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.596280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.596563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] PATH_INFO: `/v3/projects/2d1d6b33b5284b57a6e56dffbcd87b5a/users/dcee798f36254283abac1cd0a4909e20/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.598585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1d6b33b5284b57a6e56dffbcd87b5a, user_id=dcee798f36254283abac1cd0a4909e20, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.600541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524778e-7df5-4d0f-88db-723f8c375172 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.601219 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.605463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38c7a-ab3f-4ef4-aee6-41da982c6a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.606345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38c7a-ab3f-4ef4-aee6-41da982c6a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.606621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38c7a-ab3f-4ef4-aee6-41da982c6a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.607364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38c7a-ab3f-4ef4-aee6-41da982c6a74 admin admin] PATH_INFO: `/v3/projects/5d8695192f244568bdaf34f100189c9f/users/74c31948a82a4578b7bc981eec6401ef/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.608870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38c7a-ab3f-4ef4-aee6-41da982c6a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8695192f244568bdaf34f100189c9f, user_id=74c31948a82a4578b7bc981eec6401ef, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.611494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff38c7a-ab3f-4ef4-aee6-41da982c6a74 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.612402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1308/2619] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:55 2022] PUT /identity/v3/projects/2d1d6b33b5284b57a6e56dffbcd87b5a/users/dcee798f36254283abac1cd0a4909e20/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:55.622268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1312/2620] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:55 2022] PUT /identity/v3/projects/5d8695192f244568bdaf34f100189c9f/users/74c31948a82a4578b7bc981eec6401ef/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:55.671778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:55.673890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.742236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c698-9c49-469b-a3ab-3304f0d037ed admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:55.801353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:55.802356 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.802712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.803050 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] PATH_INFO: `/v3/projects/3502a0c3be0443b29e70ae41f71397d3` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.804799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3502a0c3be0443b29e70ae41f71397d3)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:55.806405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:55.853970 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3502a0c3be0443b29e70ae41f71397d3', 'request_id': 'req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.872462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3502a0c3be0443b29e70ae41f71397d3', 'request_id': 'req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.880110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3502a0c3be0443b29e70ae41f71397d3', 'request_id': 'req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.894754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] The token cache is being invalidate because project 3502a0c3be0443b29e70ae41f71397d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:55.895229 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.895935 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-62bf6a58-eecb-464e-b6ad-8f7e4978ff42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:55.905239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1309/2621] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:55 2022] DELETE /identity/v3/projects/3502a0c3be0443b29e70ae41f71397d3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:55.905448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d134ee-e09f-4e86-9ffb-b30aa3b46be0 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.905448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d134ee-e09f-4e86-9ffb-b30aa3b46be0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.905448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d134ee-e09f-4e86-9ffb-b30aa3b46be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:55.924062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-a7d134ee-e09f-4e86-9ffb-b30aa3b46be0 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:55.925280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a7d134ee-e09f-4e86-9ffb-b30aa3b46be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:55.989348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1313/2622] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:55.997838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818c0b-5d3c-4b56-8ec6-536edb539884 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:55.998542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818c0b-5d3c-4b56-8ec6-536edb539884 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:55.998542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818c0b-5d3c-4b56-8ec6-536edb539884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.018897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-30818c0b-5d3c-4b56-8ec6-536edb539884 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:56.020108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-30818c0b-5d3c-4b56-8ec6-536edb539884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:56.029091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1310/2623] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:56.034579 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d134ee-e09f-4e86-9ffb-b30aa3b46be0 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.044550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d134ee-e09f-4e86-9ffb-b30aa3b46be0 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.048947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.049600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.049878 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.050583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.050922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:56.051220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.052798 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.065108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1314/2624] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:00:56.069613 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30818c0b-5d3c-4b56-8ec6-536edb539884 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.079012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30818c0b-5d3c-4b56-8ec6-536edb539884 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.083988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.084646 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.084929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.085205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.085949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.087897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.142779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.150906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1311/2625] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:56 2022] POST /identity/v3/projects => generated 409 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:56.155533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262248-c8a7-4294-baba-ccc80cd21727 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.244135 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.244813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.245217 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.245493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.246297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.248139 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.286754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1315/2626] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:56 2022] POST /identity/v3/users => generated 305 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:56.291162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.303657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13a44-7819-43a6-ab75-f584582806eb admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.309454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.310276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.310607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.310940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.311746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.313339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.329464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1312/2627] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:56.330314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.341657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e3c9-5cef-42b0-9af1-44959fd0c4ea admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.347809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ee8be-9440-4bff-8a4b-0b424de93f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.348551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee8be-9440-4bff-8a4b-0b424de93f5c admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.348899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee8be-9440-4bff-8a4b-0b424de93f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.349233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ee8be-9440-4bff-8a4b-0b424de93f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.350051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ee8be-9440-4bff-8a4b-0b424de93f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.351921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ee8be-9440-4bff-8a4b-0b424de93f5c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.362456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1316/2628] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:56.367333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.378642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c5a-62c1-4bbd-8f31-b1e1f67bb54e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.384414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e00b66-88e9-4e0b-8d62-5cb7bffd4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.385713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00b66-88e9-4e0b-8d62-5cb7bffd4d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.386011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00b66-88e9-4e0b-8d62-5cb7bffd4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.386455 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e00b66-88e9-4e0b-8d62-5cb7bffd4d62 admin admin] PATH_INFO: `/v3/projects/c9d0f85b2b134426a50a1de467e74d70/users/95d7bbb0bd4f416d884117e5cb14d0ac/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.403524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e00b66-88e9-4e0b-8d62-5cb7bffd4d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d0f85b2b134426a50a1de467e74d70, user_id=95d7bbb0bd4f416d884117e5cb14d0ac, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.406212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e00b66-88e9-4e0b-8d62-5cb7bffd4d62 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.423938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1313/2629] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:56 2022] PUT /identity/v3/projects/c9d0f85b2b134426a50a1de467e74d70/users/95d7bbb0bd4f416d884117e5cb14d0ac/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:56.434704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82749915-3588-4615-a905-0722fdcc8db0 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.435019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82749915-3588-4615-a905-0722fdcc8db0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.435721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82749915-3588-4615-a905-0722fdcc8db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.471685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-82749915-3588-4615-a905-0722fdcc8db0 None None] MFA Rules not processed for user `95d7bbb0bd4f416d884117e5cb14d0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:56.484498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-82749915-3588-4615-a905-0722fdcc8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:56.507757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e733-e334-487f-860f-14343725f381 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.508327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e733-e334-487f-860f-14343725f381 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.508808 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89e733-e334-487f-860f-14343725f381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.547784 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-0b89e733-e334-487f-860f-14343725f381 None None] MFA Rules not processed for user `dcee798f36254283abac1cd0a4909e20`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:56.549265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0b89e733-e334-487f-860f-14343725f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:56.574672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1317/2630] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:56.574672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.574990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.575072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.606824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] MFA Rules not processed for user `74c31948a82a4578b7bc981eec6401ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:56.608358 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:56.623463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1314/2631] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:56.624720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e733-e334-487f-860f-14343725f381 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.691662 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1318/2632] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:56.693829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.697220 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:56.706682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89e733-e334-487f-860f-14343725f381 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.714383 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.715052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.715330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.715599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.716290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.720080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.768524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1315/2633] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:56 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:56.773147 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.803988 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7f0e-af77-4552-806c-e4b372072053 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.858829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982a422-c5f9-4562-8f4b-6d4f16e291e9 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.870407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.871830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.872478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.872762 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.873615 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.876738 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.885596 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.886289 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.886571 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.886842 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.889074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:56.908076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1316/2634] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:56 2022] POST /identity/v3/users => generated 311 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:00:56.909179 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.920425 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5edb40-4364-4d2b-8c38-ad68c869e5ce admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.925460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.926472 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.926932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.927510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.928721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.930619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.942557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1317/2635] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:56.947178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:56.959106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e951bc-ccc3-4559-b3f4-29e4340245a1 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:56.963567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.965022 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:56.965250 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:56.966541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:56.966981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:56.967598 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] PATH_INFO: `/v3/projects/a3190a60c7c54ca5abc544a4513b10e7/users/6be8f7847e194873a5a076d232d691a2/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:56.979246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1319/2636] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:56.995878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3190a60c7c54ca5abc544a4513b10e7, user_id=6be8f7847e194873a5a076d232d691a2, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:56.998637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:57.018332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1318/2637] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:56 2022] PUT /identity/v3/projects/a3190a60c7c54ca5abc544a4513b10e7/users/6be8f7847e194873a5a076d232d691a2/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:57.019823 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:57.031725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4db42-7d7c-41d2-8c34-91ba3cfb22ef service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:57.093716 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be146-8cb9-428f-a583-c51ba448bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:57.094452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be146-8cb9-428f-a583-c51ba448bd27 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:57.094696 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be146-8cb9-428f-a583-c51ba448bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:57.094968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be146-8cb9-428f-a583-c51ba448bd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:57.095792 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be146-8cb9-428f-a583-c51ba448bd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:57.097459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be146-8cb9-428f-a583-c51ba448bd27 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:57.108385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1320/2638] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:57.112341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:57.127519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d05179-e1b2-448d-950c-c9ee15b49aad admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:57.133210 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:57.134373 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:57.134766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:57.135141 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] PATH_INFO: `/v3/projects/a3190a60c7c54ca5abc544a4513b10e7/users/6be8f7847e194873a5a076d232d691a2/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:57.137527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3190a60c7c54ca5abc544a4513b10e7, user_id=6be8f7847e194873a5a076d232d691a2, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:57.140243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:57.152609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1319/2639] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:57 2022] PUT /identity/v3/projects/a3190a60c7c54ca5abc544a4513b10e7/users/6be8f7847e194873a5a076d232d691a2/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:57.165919 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257259-6d0a-446c-a0f4-cb549e82d2dd None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:57.166280 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257259-6d0a-446c-a0f4-cb549e82d2dd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:57.166560 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257259-6d0a-446c-a0f4-cb549e82d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:57.196976 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-18257259-6d0a-446c-a0f4-cb549e82d2dd None None] MFA Rules not processed for user `6be8f7847e194873a5a076d232d691a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:57.198416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-18257259-6d0a-446c-a0f4-cb549e82d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:57.275641 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1321/2640] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:57.288481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:57.355991 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb5063-f28e-4c8e-aa52-3c95d412f90f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:57.360249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:57.360948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:57.361234 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:57.361523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:57.372457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:57.374269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:57.384788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1320/2641] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:57.535348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18257259-6d0a-446c-a0f4-cb549e82d2dd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:57.544933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18257259-6d0a-446c-a0f4-cb549e82d2dd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:57.549024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:57.549837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:57.550149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:57.550418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:57.605825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:57.607307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:57.617137 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1322/2642] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:57.823333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:57.825106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:57.901427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd66f-6f40-426f-84f9-d3d44f7307e5 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:57.908225 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:57.909113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:57.909390 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:57.909683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] PATH_INFO: `/v3/users/ca8983e94f344298ba644668c85e9e7f` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:57.911032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8983e94f344298ba644668c85e9e7f)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:57.913362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:57.961106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8983e94f344298ba644668c85e9e7f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:57.973500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8983e94f344298ba644668c85e9e7f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:57.980003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8983e94f344298ba644668c85e9e7f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:57.988231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8983e94f344298ba644668c85e9e7f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:57.988956 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8983e94f344298ba644668c85e9e7f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:57.994830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1321/2643] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:57 2022] DELETE /identity/v3/users/ca8983e94f344298ba644668c85e9e7f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:00:58.182565 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:58.193487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be9d7c-7074-45d7-bc2d-120f9b79530d service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:58.247667 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:58.248536 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:58.248815 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:58.249083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] PATH_INFO: `/v3/projects/241efd1c476d452c8a6128322fd6a335` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:58.250292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] RBAC: Authorizing `identity:delete_project(project_id=241efd1c476d452c8a6128322fd6a335)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:58.252196 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:58.304081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241efd1c476d452c8a6128322fd6a335', 'request_id': 'req-6cfc52c8-124e-4337-9bf3-d34a912e724d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.311973 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241efd1c476d452c8a6128322fd6a335', 'request_id': 'req-6cfc52c8-124e-4337-9bf3-d34a912e724d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.317834 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241efd1c476d452c8a6128322fd6a335', 'request_id': 'req-6cfc52c8-124e-4337-9bf3-d34a912e724d'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.329534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] The token cache is being invalidate because project 241efd1c476d452c8a6128322fd6a335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:58.329817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.330527 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.332112 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1323/2644] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:58 2022] DELETE /identity/v3/projects/241efd1c476d452c8a6128322fd6a335 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:58.336274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:58.337966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:58.352106 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebbf08-aab8-4e40-81f3-ef183196bd6c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:58.392237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:58.393808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:58.406364 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:58.407240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:58.407508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:58.407783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] PATH_INFO: `/v3/users/74c31948a82a4578b7bc981eec6401ef` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:58.408958 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c31948a82a4578b7bc981eec6401ef)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:58.410865 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:58.452512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc52c8-124e-4337-9bf3-d34a912e724d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:58.456780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279eb78-57bc-4091-8a98-cd6a598c5701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:58.457426 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279eb78-57bc-4091-8a98-cd6a598c5701 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:58.457703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279eb78-57bc-4091-8a98-cd6a598c5701 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:58.459246 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279eb78-57bc-4091-8a98-cd6a598c5701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:58.459977 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c31948a82a4578b7bc981eec6401ef'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.461323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6279eb78-57bc-4091-8a98-cd6a598c5701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:58.471338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c31948a82a4578b7bc981eec6401ef'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.477804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c31948a82a4578b7bc981eec6401ef'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.486183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c31948a82a4578b7bc981eec6401ef'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.486862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c31948a82a4578b7bc981eec6401ef'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.492938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1322/2645] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:00:58 2022] DELETE /identity/v3/users/74c31948a82a4578b7bc981eec6401ef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:58.524556 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279eb78-57bc-4091-8a98-cd6a598c5701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:58.526026 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279eb78-57bc-4091-8a98-cd6a598c5701 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:58.535684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1324/2646] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:00:58.664780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:58.666399 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:58.749756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb84fc-6683-48e5-a9ca-8f88af0927f3 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:58.754304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:58.755202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:58.755479 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:58.755754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] PATH_INFO: `/v3/projects/5d8695192f244568bdaf34f100189c9f` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:58.757015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8695192f244568bdaf34f100189c9f)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:58.758987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:58.803366 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8695192f244568bdaf34f100189c9f', 'request_id': 'req-729e08c3-d5c2-4147-84ec-10edb0a4a06b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.812927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8695192f244568bdaf34f100189c9f', 'request_id': 'req-729e08c3-d5c2-4147-84ec-10edb0a4a06b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.818261 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8695192f244568bdaf34f100189c9f', 'request_id': 'req-729e08c3-d5c2-4147-84ec-10edb0a4a06b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.828653 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] The token cache is being invalidate because project 5d8695192f244568bdaf34f100189c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:00:58.828950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.829937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-729e08c3-d5c2-4147-84ec-10edb0a4a06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:00:58.831535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1323/2647] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:00:58 2022] DELETE /identity/v3/projects/5d8695192f244568bdaf34f100189c9f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:58.837572 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275540-e050-4196-8e52-d888a9068c8a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:58.837856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275540-e050-4196-8e52-d888a9068c8a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:58.838153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275540-e050-4196-8e52-d888a9068c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:58.855475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-66275540-e050-4196-8e52-d888a9068c8a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:58.856774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-66275540-e050-4196-8e52-d888a9068c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:58.915657 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1325/2648] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:58.923962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb4da4-a052-4108-bfb5-d90c844f5e22 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:58.924444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb4da4-a052-4108-bfb5-d90c844f5e22 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:58.924535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb4da4-a052-4108-bfb5-d90c844f5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:58.944512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2bdb4da4-a052-4108-bfb5-d90c844f5e22 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:58.945822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2bdb4da4-a052-4108-bfb5-d90c844f5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:58.955592 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1324/2649] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:58.959922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275540-e050-4196-8e52-d888a9068c8a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:58.970319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275540-e050-4196-8e52-d888a9068c8a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:58.975281 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:58.976047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:58.976399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:58.976682 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:58.977414 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:00:58.977719 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:58.979334 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:58.995128 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1326/2650] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:00:58.996304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb4da4-a052-4108-bfb5-d90c844f5e22 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.005698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb4da4-a052-4108-bfb5-d90c844f5e22 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.010488 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.011156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.011435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.011756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.012460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.017135 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.048877 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1325/2651] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:58 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:59.053442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.065616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ecd93-661e-4748-9e0f-a997bdca95c2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.135561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.136345 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.136827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.137162 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.137960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.140340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.165200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1327/2652] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:59 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:59.170595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.181084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61133b-46f7-4b5a-b1e2-cdc5d9e8efe2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.185911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.186666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.186939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.187207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.187953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.189602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.202199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1326/2653] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:59.206864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.217829 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e79d-7da9-465e-9b2f-1471e9ebb1ae admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.222580 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330f67f-bac5-4a69-87ae-cfdec2a12ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.223243 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330f67f-bac5-4a69-87ae-cfdec2a12ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.223520 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330f67f-bac5-4a69-87ae-cfdec2a12ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.223822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330f67f-bac5-4a69-87ae-cfdec2a12ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.224745 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330f67f-bac5-4a69-87ae-cfdec2a12ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.226416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330f67f-bac5-4a69-87ae-cfdec2a12ff1 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.236380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1328/2654] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:59.240580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.251148 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e38e9a-3e27-4161-90ce-ed58f79db58b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.256720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.257605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.257880 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.258177 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] PATH_INFO: `/v3/projects/0726ca3a13724f0bb88fb856a615c2d2/users/b24df44d0d9d4f30a20b25ab9797aeb8/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.273069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0726ca3a13724f0bb88fb856a615c2d2, user_id=b24df44d0d9d4f30a20b25ab9797aeb8, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.275790 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.291037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1327/2655] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:59 2022] PUT /identity/v3/projects/0726ca3a13724f0bb88fb856a615c2d2/users/b24df44d0d9d4f30a20b25ab9797aeb8/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:59.301548 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c0032-266c-490c-b8ad-c72f106573cc None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.301960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c0032-266c-490c-b8ad-c72f106573cc None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.302286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c0032-266c-490c-b8ad-c72f106573cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.328783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e47c0032-266c-490c-b8ad-c72f106573cc None None] MFA Rules not processed for user `b24df44d0d9d4f30a20b25ab9797aeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:59.330364 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e47c0032-266c-490c-b8ad-c72f106573cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:59.401424 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1329/2656] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:59.406125 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.470263 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71038f20-f0c8-4892-acbd-4cab320c1f8b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.475350 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.475993 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.476275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.476556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.477294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.479216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.507664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1328/2657] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:00:59 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:59.511886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c0032-266c-490c-b8ad-c72f106573cc None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.522910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c0032-266c-490c-b8ad-c72f106573cc None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.589045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.590024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.590373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.590632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.591598 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.594666 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.619546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1330/2658] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:00:59 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:00:59.623871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.635093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d196a78-4d54-4c2c-a519-25e98a0ff07d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.640168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.640950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.641315 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.641595 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.642381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.643990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.654596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1329/2659] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:00:59.658786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.668537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1457e5-3c73-452d-872c-cd46d713a734 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.673514 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.674440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.674717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.674972 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] PATH_INFO: `/v3/projects/fd6d2a655cff4975bbeb4d85d53620b6/users/72c90ad9fbaa4a8398e292ee611c062b/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.689352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6d2a655cff4975bbeb4d85d53620b6, user_id=72c90ad9fbaa4a8398e292ee611c062b, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.692007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.706605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1331/2660] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:59 2022] PUT /identity/v3/projects/fd6d2a655cff4975bbeb4d85d53620b6/users/72c90ad9fbaa4a8398e292ee611c062b/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:59.711810 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.722053 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05288b6-8372-4461-b9f8-6254e7a8f8fa admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.779071 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eb630-c469-4461-b602-c6fd06c7b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.779750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb630-c469-4461-b602-c6fd06c7b03a admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.780032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb630-c469-4461-b602-c6fd06c7b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.780307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eb630-c469-4461-b602-c6fd06c7b03a admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.781039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eb630-c469-4461-b602-c6fd06c7b03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.782670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eb630-c469-4461-b602-c6fd06c7b03a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.792741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1330/2661] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:00:59.796984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.807326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594c9d5-ebdf-40b9-ba98-94730111a388 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:00:59.812507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96223381-a8af-4845-89be-789f623a293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:00:59.813488 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96223381-a8af-4845-89be-789f623a293b admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.813827 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96223381-a8af-4845-89be-789f623a293b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.814160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96223381-a8af-4845-89be-789f623a293b admin admin] PATH_INFO: `/v3/projects/fd6d2a655cff4975bbeb4d85d53620b6/users/72c90ad9fbaa4a8398e292ee611c062b/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.816263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96223381-a8af-4845-89be-789f623a293b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6d2a655cff4975bbeb4d85d53620b6, user_id=72c90ad9fbaa4a8398e292ee611c062b, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:00:59.818893 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96223381-a8af-4845-89be-789f623a293b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:00:59.830428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1332/2662] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:00:59 2022] PUT /identity/v3/projects/fd6d2a655cff4975bbeb4d85d53620b6/users/72c90ad9fbaa4a8398e292ee611c062b/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:00:59.842076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:00:59.842386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:00:59.842636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:00:59.870206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] MFA Rules not processed for user `72c90ad9fbaa4a8398e292ee611c062b`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:00:59.871382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:00:59.938660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1331/2663] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:00:59.949237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96223381-a8af-4845-89be-789f623a293b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:00:59.951061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-96223381-a8af-4845-89be-789f623a293b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:00.014123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96223381-a8af-4845-89be-789f623a293b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:00.018639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:00.019475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:00.019659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:00.020070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:00.031263 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:00.032729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:00.042631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1333/2664] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:00:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:00.091052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:00.092938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:00.106011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3365fa6-ba40-490f-8c18-5afa9dc2c3a0 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:00.109666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2dc9a-4e92-4b4d-8553-5e3c9d484e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:00.110335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2dc9a-4e92-4b4d-8553-5e3c9d484e9a service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:00.110620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2dc9a-4e92-4b4d-8553-5e3c9d484e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:00.110899 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2dc9a-4e92-4b4d-8553-5e3c9d484e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:00.170333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2dc9a-4e92-4b4d-8553-5e3c9d484e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:00.171934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2dc9a-4e92-4b4d-8553-5e3c9d484e9a service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:00.181003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1332/2665] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:04.481911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:04.545709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea30b-304a-40ac-a626-d92113997062 service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:04.550697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:04.551559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:04.551841 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:04.552114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] PATH_INFO: `/v3/users/b24df44d0d9d4f30a20b25ab9797aeb8` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:04.553437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24df44d0d9d4f30a20b25ab9797aeb8)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:04.555438 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:04.603450 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24df44d0d9d4f30a20b25ab9797aeb8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:04.610316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24df44d0d9d4f30a20b25ab9797aeb8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:04.611119 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24df44d0d9d4f30a20b25ab9797aeb8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:04.611809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24df44d0d9d4f30a20b25ab9797aeb8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:04.624550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24df44d0d9d4f30a20b25ab9797aeb8'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:04.638234 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1334/2666] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:04 2022] DELETE /identity/v3/users/b24df44d0d9d4f30a20b25ab9797aeb8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:04.644021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:04.644582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:04.644582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:04.666124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:04.667354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:04.746025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1333/2667] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:04.756609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:04.759034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:04.820609 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f09469-a8b3-4a0a-b253-eed002b2bb88 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:04.824583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:04.825224 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:04.825507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:04.825785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:04.836387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:04.837814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:04.848578 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1335/2668] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:05.125183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:05.129994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:05.139847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff85c8-9f26-43b5-933c-327552041a30 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:05.146679 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:05.147950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:05.148231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:05.148647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] PATH_INFO: `/v3/projects/0726ca3a13724f0bb88fb856a615c2d2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:05.150033 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0726ca3a13724f0bb88fb856a615c2d2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:05.154149 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:05.209162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0726ca3a13724f0bb88fb856a615c2d2', 'request_id': 'req-1e7375fe-e0c1-404a-b4e9-92423a73ac79'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.217222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0726ca3a13724f0bb88fb856a615c2d2', 'request_id': 'req-1e7375fe-e0c1-404a-b4e9-92423a73ac79'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.222508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0726ca3a13724f0bb88fb856a615c2d2', 'request_id': 'req-1e7375fe-e0c1-404a-b4e9-92423a73ac79'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.233233 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] The token cache is being invalidate because project 0726ca3a13724f0bb88fb856a615c2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:05.233518 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.234170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.235809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1334/2669] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:05 2022] DELETE /identity/v3/projects/0726ca3a13724f0bb88fb856a615c2d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:05.239801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:05.249369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc078-0c31-4f98-a90f-ac2a65554559 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:05.304763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:05.305856 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:05.306236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:05.306601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] PATH_INFO: `/v3/users/72c90ad9fbaa4a8398e292ee611c062b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:05.308138 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c90ad9fbaa4a8398e292ee611c062b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:05.310359 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:05.357912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c90ad9fbaa4a8398e292ee611c062b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.364512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c90ad9fbaa4a8398e292ee611c062b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.365260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c90ad9fbaa4a8398e292ee611c062b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.365964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c90ad9fbaa4a8398e292ee611c062b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.378569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-875f5ec8-1b1b-4940-b07f-cd35a607ef83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c90ad9fbaa4a8398e292ee611c062b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.392688 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1336/2670] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:05 2022] DELETE /identity/v3/users/72c90ad9fbaa4a8398e292ee611c062b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:05.653545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:05.655132 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:05.667884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7375fe-e0c1-404a-b4e9-92423a73ac79 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:05.726487 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:05.727342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:05.727621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:05.727894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] PATH_INFO: `/v3/projects/fd6d2a655cff4975bbeb4d85d53620b6` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:05.729080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6d2a655cff4975bbeb4d85d53620b6)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:05.731030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:05.779795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6d2a655cff4975bbeb4d85d53620b6', 'request_id': 'req-92983805-0920-4f00-a204-3a3b3e7581a8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.789126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6d2a655cff4975bbeb4d85d53620b6', 'request_id': 'req-92983805-0920-4f00-a204-3a3b3e7581a8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.795162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6d2a655cff4975bbeb4d85d53620b6', 'request_id': 'req-92983805-0920-4f00-a204-3a3b3e7581a8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.807034 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] The token cache is being invalidate because project fd6d2a655cff4975bbeb4d85d53620b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:05.807310 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.808126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-92983805-0920-4f00-a204-3a3b3e7581a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:05.809837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1335/2671] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:05 2022] DELETE /identity/v3/projects/fd6d2a655cff4975bbeb4d85d53620b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:05.814607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8cdc7-8eae-4cdc-a92e-fd780237fc35 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:05.815068 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8cdc7-8eae-4cdc-a92e-fd780237fc35 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:05.815288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8cdc7-8eae-4cdc-a92e-fd780237fc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:05.835632 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-43f8cdc7-8eae-4cdc-a92e-fd780237fc35 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:05.838634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-43f8cdc7-8eae-4cdc-a92e-fd780237fc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:05.906001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1337/2672] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:05.914012 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:05.914342 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:05.914619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:05.936239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:05.937446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:05.946862 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1336/2673] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:05.951452 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8cdc7-8eae-4cdc-a92e-fd780237fc35 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:05.964044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8cdc7-8eae-4cdc-a92e-fd780237fc35 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:05.972254 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:05.974688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:05.979845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:05.980524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:05.980804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:05.981099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:05.981830 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:05.982378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:05.983986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:05.986450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2d1be-63fa-453e-813f-a70eac6062dc None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:05.991329 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:05.992440 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:05.992721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:05.993001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] PATH_INFO: `/v3/users/95d7bbb0bd4f416d884117e5cb14d0ac` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:05.994281 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d7bbb0bd4f416d884117e5cb14d0ac)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:05.996354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:05.996958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1338/2674] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:01:06.001397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.014493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f825ebf-9894-46e9-880c-287f10b05549 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.019635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.020296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.020586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.020860 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.021721 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.023771 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.051340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1339/2675] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:06 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:06.055237 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.057057 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d7bbb0bd4f416d884117e5cb14d0ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.078684 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d7bbb0bd4f416d884117e5cb14d0ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.086636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d7bbb0bd4f416d884117e5cb14d0ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.095575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d7bbb0bd4f416d884117e5cb14d0ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.096220 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8b782575-413b-4aad-bf9d-e4d4d2f84d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d7bbb0bd4f416d884117e5cb14d0ac'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.102422 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1337/2676] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:05 2022] DELETE /identity/v3/users/95d7bbb0bd4f416d884117e5cb14d0ac => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:06.106902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.107192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.107465 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.125621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:06.126860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:06.134271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d21862-439b-491f-aa81-3263a4bcd89f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.186551 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1338/2677] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:01:06.191227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.191951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.192235 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.192511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.193255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.195691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.196827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.198338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:06.218369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1340/2678] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:06 2022] POST /identity/v3/users => generated 280 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:06.224989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.227371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:06.243130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe21101-0af0-48a8-9eaa-361dbaeba875 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.249075 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.249787 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.250164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.250518 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.251319 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.253037 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.263328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7eb1-26eb-4223-9dbd-c6eab8627b75 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.264109 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1341/2679] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:06.267646 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.268232 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.269305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.269666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.271216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.281477 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9a7a-cff2-4f55-974b-5435ee964261 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.281998 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.284110 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.291378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482f6fa-3434-41f9-ac07-7ef5326857e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.292081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482f6fa-3434-41f9-ac07-7ef5326857e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.292387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482f6fa-3434-41f9-ac07-7ef5326857e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.292663 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482f6fa-3434-41f9-ac07-7ef5326857e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.293441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482f6fa-3434-41f9-ac07-7ef5326857e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.294655 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1339/2680] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:01:06.295056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482f6fa-3434-41f9-ac07-7ef5326857e1 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.307454 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1342/2681] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:06.312011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.322369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29f023-714b-423d-bb0b-31347f72950c service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.328238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.328826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.329460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.329709 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] PATH_INFO: `/v3/projects/f43e643761c14728b9088883cffb5f06/users/8936f25f5dac408fa1ae4eb9d10dd10f/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.346798 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43e643761c14728b9088883cffb5f06, user_id=8936f25f5dac408fa1ae4eb9d10dd10f, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.349682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.363954 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1340/2682] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:06 2022] PUT /identity/v3/projects/f43e643761c14728b9088883cffb5f06/users/8936f25f5dac408fa1ae4eb9d10dd10f/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:06.374871 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.375161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.375439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.402011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] MFA Rules not processed for user `8936f25f5dac408fa1ae4eb9d10dd10f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:06.403267 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:06.469123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1343/2683] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:06.480525 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.482398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:06.539397 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370c7a6-6423-4e48-a8e4-9965d01a93a8 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.543047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.543702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.543987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.544267 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.553111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.554830 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.563444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.564866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1341/2684] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:06 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:06.565023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:06.635559 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb18060-dfb1-4f59-a30d-5e11e4f4deb1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.640031 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.640881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.641152 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.641412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] PATH_INFO: `/v3/projects/c9d0f85b2b134426a50a1de467e74d70` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.642654 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d0f85b2b134426a50a1de467e74d70)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.644528 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.688446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d0f85b2b134426a50a1de467e74d70', 'request_id': 'req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.703615 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d0f85b2b134426a50a1de467e74d70', 'request_id': 'req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.709992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d0f85b2b134426a50a1de467e74d70', 'request_id': 'req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.722300 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] The token cache is being invalidate because project c9d0f85b2b134426a50a1de467e74d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:06.722585 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.723305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.725095 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1344/2685] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:06 2022] DELETE /identity/v3/projects/c9d0f85b2b134426a50a1de467e74d70 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:06.729144 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:06.740506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81830f4f-5853-4975-92fd-ed7bd8b37111 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:06.797038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:06.797984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:06.798327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:06.798582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] PATH_INFO: `/v3/users/6be8f7847e194873a5a076d232d691a2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:06.799778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be8f7847e194873a5a076d232d691a2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:06.803152 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:06.857861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be8f7847e194873a5a076d232d691a2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.868395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be8f7847e194873a5a076d232d691a2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.875170 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be8f7847e194873a5a076d232d691a2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.883376 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be8f7847e194873a5a076d232d691a2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.884042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-f61da36c-8f07-4403-8bc2-35e35a5cb611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be8f7847e194873a5a076d232d691a2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:06.890730 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1342/2686] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:06 2022] DELETE /identity/v3/users/6be8f7847e194873a5a076d232d691a2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:07.160028 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:07.162369 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:07.182480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e310e9-d37e-48fc-a089-9dc5fe6a7af5 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:07.252422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:07.253341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.253704 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.253984 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] PATH_INFO: `/v3/projects/a3190a60c7c54ca5abc544a4513b10e7` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.267702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3190a60c7c54ca5abc544a4513b10e7)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:07.267702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:07.325216 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3190a60c7c54ca5abc544a4513b10e7', 'request_id': 'req-1703202d-e210-4b78-9651-e63953df719a'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:07.335000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3190a60c7c54ca5abc544a4513b10e7', 'request_id': 'req-1703202d-e210-4b78-9651-e63953df719a'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:07.341639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3190a60c7c54ca5abc544a4513b10e7', 'request_id': 'req-1703202d-e210-4b78-9651-e63953df719a'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:07.353903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] The token cache is being invalidate because project a3190a60c7c54ca5abc544a4513b10e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:07.354215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:07.354911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1703202d-e210-4b78-9651-e63953df719a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:07.356412 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1345/2687] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:07 2022] DELETE /identity/v3/projects/a3190a60c7c54ca5abc544a4513b10e7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:07.361609 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870eac0-5526-4177-90e9-866b2d68fc5c None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.361988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870eac0-5526-4177-90e9-866b2d68fc5c None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.362365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870eac0-5526-4177-90e9-866b2d68fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.382231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3870eac0-5526-4177-90e9-866b2d68fc5c None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:07.383712 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3870eac0-5526-4177-90e9-866b2d68fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:07.447271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1343/2688] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:07.455735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60014-5935-4ed1-bef6-52a996bbd172 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.456019 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60014-5935-4ed1-bef6-52a996bbd172 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.456283 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60014-5935-4ed1-bef6-52a996bbd172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.475442 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3fd60014-5935-4ed1-bef6-52a996bbd172 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:07.476655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3fd60014-5935-4ed1-bef6-52a996bbd172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:07.486001 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1346/2689] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:07.490367 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870eac0-5526-4177-90e9-866b2d68fc5c None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:07.500378 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870eac0-5526-4177-90e9-866b2d68fc5c None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:07.505994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:07.506685 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.506972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.507246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.507969 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:07.508277 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:07.509869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:07.521964 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1344/2690] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:01:07.526778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60014-5935-4ed1-bef6-52a996bbd172 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:07.541397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60014-5935-4ed1-bef6-52a996bbd172 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:07.549070 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:07.549709 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.549981 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.550290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.550967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:07.552868 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:07.582888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1347/2691] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:07 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:07.587127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:07.597161 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5fc0-12cd-45ba-bf1e-23a0c9e350db admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:07.660647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:07.661339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.661620 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.661948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.662669 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:07.664630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:07.689450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1345/2692] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:07 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:07.694539 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:07.709247 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74d25e-6d36-4931-9199-d69f246dd3c7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:07.714725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:07.715387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.715673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.715950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.716684 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:07.718320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:07.729181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1348/2693] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:07.733948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:07.745062 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83305c-2c89-40c5-8f68-949eea852647 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:07.750126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c57e09-17a0-46f7-a6ab-e9f9a17ad471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:07.750836 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c57e09-17a0-46f7-a6ab-e9f9a17ad471 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.751181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c57e09-17a0-46f7-a6ab-e9f9a17ad471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.751445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c57e09-17a0-46f7-a6ab-e9f9a17ad471 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.752201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c57e09-17a0-46f7-a6ab-e9f9a17ad471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:07.753799 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c57e09-17a0-46f7-a6ab-e9f9a17ad471 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:07.769131 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1346/2694] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:07.773500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:07.784136 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878f1a4-5cb3-42e8-a24c-1be6012dff6f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:07.789427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:07.790456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.790761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.791065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] PATH_INFO: `/v3/projects/8770be96b6b34e159ad7f627e794ae63/users/cc9872bd49b840a9ab954e5762b96acf/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.806455 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8770be96b6b34e159ad7f627e794ae63, user_id=cc9872bd49b840a9ab954e5762b96acf, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:07.809459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:07.822727 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1349/2695] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:07 2022] PUT /identity/v3/projects/8770be96b6b34e159ad7f627e794ae63/users/cc9872bd49b840a9ab954e5762b96acf/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:07.833506 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d51acd-17eb-40fc-9994-183f252f1bb5 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:07.833795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d51acd-17eb-40fc-9994-183f252f1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:07.834068 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d51acd-17eb-40fc-9994-183f252f1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:07.862698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-86d51acd-17eb-40fc-9994-183f252f1bb5 None None] MFA Rules not processed for user `cc9872bd49b840a9ab954e5762b96acf`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:07.863994 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-86d51acd-17eb-40fc-9994-183f252f1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:07.935192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1347/2696] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:07.946475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.012690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d385-0bc1-470b-8ce6-b171c56c122e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.017645 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.018333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.018602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.018875 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.019577 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.021586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.049200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1350/2697] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:07 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:08.055360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d51acd-17eb-40fc-9994-183f252f1bb5 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.066049 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d51acd-17eb-40fc-9994-183f252f1bb5 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.124644 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.125439 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.125721 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.125995 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.126803 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.128713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.152607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1348/2698] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:08 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:08.154120 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.164525 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38e2c-3fee-46fc-92ff-4ef2f1080b31 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.169783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.170490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.170774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.171081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.171816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.173511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.184517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1351/2699] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:08.188901 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.199313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e370-13c9-4bcb-b73e-d21485d7191b admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.205304 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36220a-330f-43a3-bd31-293449741ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.205992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36220a-330f-43a3-bd31-293449741ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.206308 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36220a-330f-43a3-bd31-293449741ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.206583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36220a-330f-43a3-bd31-293449741ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.207365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36220a-330f-43a3-bd31-293449741ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.208944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36220a-330f-43a3-bd31-293449741ed1 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.219279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1349/2700] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:08.223583 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.235183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7c618-aa71-4b84-bc73-eed448b3e94a admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.240568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.241468 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.241752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.242029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] PATH_INFO: `/v3/projects/f0f7c641157a4cbe833dbaf9a963ca3d/users/81cecd13a88240c5af3b1a25210f461b/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.258690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f7c641157a4cbe833dbaf9a963ca3d, user_id=81cecd13a88240c5af3b1a25210f461b, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.261348 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.274992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1352/2701] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:08 2022] PUT /identity/v3/projects/f0f7c641157a4cbe833dbaf9a963ca3d/users/81cecd13a88240c5af3b1a25210f461b/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:08.342984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5343f-e5b4-4c16-b3d8-e1690e1149e2 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.343269 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5343f-e5b4-4c16-b3d8-e1690e1149e2 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.343541 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5343f-e5b4-4c16-b3d8-e1690e1149e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.373191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-76a5343f-e5b4-4c16-b3d8-e1690e1149e2 None None] MFA Rules not processed for user `81cecd13a88240c5af3b1a25210f461b`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:08.374437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-76a5343f-e5b4-4c16-b3d8-e1690e1149e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:08.439696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1350/2702] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:08.444484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.504922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee25933-df1e-4c7a-a436-6f45d5e17f32 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.509507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.510199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.510484 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.510759 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.511490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.513400 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.540134 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1353/2703] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:08 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:08.544306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5343f-e5b4-4c16-b3d8-e1690e1149e2 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.555126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5343f-e5b4-4c16-b3d8-e1690e1149e2 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.612910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.613602 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.613888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.614208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.614921 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.616892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.638992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1351/2704] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:08 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:08.643256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.653588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe7be-b99e-4987-9b3c-20bdd4f3c479 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.658772 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.659447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.659748 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.660024 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.660758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.662406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.672847 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1354/2705] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:01:08.677118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.687690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a12319-8498-42fc-b731-663ae486b61d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.692824 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.693702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.693985 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.694294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] PATH_INFO: `/v3/projects/1943c6389f5f42489ab328ed2aff4b73/users/15cabe471c8749d0bcab485a93f05ac2/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.709586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1943c6389f5f42489ab328ed2aff4b73, user_id=15cabe471c8749d0bcab485a93f05ac2, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.712309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.728743 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1352/2706] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:08 2022] PUT /identity/v3/projects/1943c6389f5f42489ab328ed2aff4b73/users/15cabe471c8749d0bcab485a93f05ac2/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:08.732425 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.743153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1dd98b-10a5-4f4e-be29-bf835e2805f3 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.805422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02398b5-b14d-4440-93f1-4b61e337b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.806101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02398b5-b14d-4440-93f1-4b61e337b1ef admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.806399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02398b5-b14d-4440-93f1-4b61e337b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.806665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02398b5-b14d-4440-93f1-4b61e337b1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.807476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02398b5-b14d-4440-93f1-4b61e337b1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.809079 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02398b5-b14d-4440-93f1-4b61e337b1ef admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.819749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1355/2707] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:01:08.824500 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.835537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0433-33a4-435a-9487-0fa39429c357 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:08.840966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:08.841891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.842206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.842480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] PATH_INFO: `/v3/projects/1943c6389f5f42489ab328ed2aff4b73/users/15cabe471c8749d0bcab485a93f05ac2/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.844553 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1943c6389f5f42489ab328ed2aff4b73, user_id=15cabe471c8749d0bcab485a93f05ac2, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:08.847278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:08.858023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1353/2708] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:08 2022] PUT /identity/v3/projects/1943c6389f5f42489ab328ed2aff4b73/users/15cabe471c8749d0bcab485a93f05ac2/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:08.868179 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:08.868463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:08.868735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:08.895751 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] MFA Rules not processed for user `15cabe471c8749d0bcab485a93f05ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:08.897147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:08.967652 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1356/2709] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:08.983252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:08.985668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:09.050606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf882ab-2ffe-4b14-93c2-1ca517bba72e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:09.054894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:09.055586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:09.055872 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:09.056172 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:09.065753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:09.067300 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:09.078650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1354/2710] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:09.124242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:09.126258 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:09.139061 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979c1b-44e6-4817-8fb2-8f566d7cd5dd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:09.142901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558b103-d2ad-4cf4-9fc2-9bfb9c03bd91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:09.143553 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558b103-d2ad-4cf4-9fc2-9bfb9c03bd91 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:09.143834 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558b103-d2ad-4cf4-9fc2-9bfb9c03bd91 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:09.144110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558b103-d2ad-4cf4-9fc2-9bfb9c03bd91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:09.208947 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558b103-d2ad-4cf4-9fc2-9bfb9c03bd91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:09.210447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558b103-d2ad-4cf4-9fc2-9bfb9c03bd91 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:09.219870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1357/2711] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:12.153768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:12.224660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb178-48f1-4b59-95fa-6448c5642421 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:12.229826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:12.230801 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:12.231082 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:12.231357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] PATH_INFO: `/v3/users/cc9872bd49b840a9ab954e5762b96acf` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:12.232680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9872bd49b840a9ab954e5762b96acf)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:12.234723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:12.287454 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9872bd49b840a9ab954e5762b96acf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.299167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9872bd49b840a9ab954e5762b96acf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.305854 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9872bd49b840a9ab954e5762b96acf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.314746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9872bd49b840a9ab954e5762b96acf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.315526 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9872bd49b840a9ab954e5762b96acf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.321793 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1355/2712] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:12 2022] DELETE /identity/v3/users/cc9872bd49b840a9ab954e5762b96acf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:12.326717 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:12.327205 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:12.327316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:12.345062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:12.346288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:12.407209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1358/2713] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:12.417665 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:12.419156 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:12.475717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20116-d3f5-4d54-b459-fbcec58ca8da admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:12.480286 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:12.480934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:12.481212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:12.481491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:12.491855 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:12.493325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:12.503590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1356/2714] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:12.774966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:12.776389 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:12.790775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d5feb-b553-4e34-bb76-443a85700bf3 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:12.797788 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:12.798590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:12.798870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:12.799129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] PATH_INFO: `/v3/projects/8770be96b6b34e159ad7f627e794ae63` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:12.800441 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8770be96b6b34e159ad7f627e794ae63)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:12.802409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:12.852986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8770be96b6b34e159ad7f627e794ae63', 'request_id': 'req-60b0ec33-0f23-4610-92e5-68b2ae524714'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.862260 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8770be96b6b34e159ad7f627e794ae63', 'request_id': 'req-60b0ec33-0f23-4610-92e5-68b2ae524714'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.868819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8770be96b6b34e159ad7f627e794ae63', 'request_id': 'req-60b0ec33-0f23-4610-92e5-68b2ae524714'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.880508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] The token cache is being invalidate because project 8770be96b6b34e159ad7f627e794ae63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:12.880840 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.881502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:12.883242 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1359/2715] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:12 2022] DELETE /identity/v3/projects/8770be96b6b34e159ad7f627e794ae63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:12.887570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:12.898268 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1684656-1411-48ca-8251-4247aca109a4 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:12.957702 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:12.958524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:12.958887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:12.959201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] PATH_INFO: `/v3/users/81cecd13a88240c5af3b1a25210f461b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:12.960643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cecd13a88240c5af3b1a25210f461b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:12.962621 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:13.013360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cecd13a88240c5af3b1a25210f461b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.026597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cecd13a88240c5af3b1a25210f461b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.034173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cecd13a88240c5af3b1a25210f461b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.044222 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cecd13a88240c5af3b1a25210f461b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.044971 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cecd13a88240c5af3b1a25210f461b'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.053631 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1357/2716] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:12 2022] DELETE /identity/v3/users/81cecd13a88240c5af3b1a25210f461b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:13.356025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:13.357491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:13.378739 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ec33-0f23-4610-92e5-68b2ae524714 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:13.456912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:13.457819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:13.458121 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:13.458387 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] PATH_INFO: `/v3/projects/f0f7c641157a4cbe833dbaf9a963ca3d` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:13.459626 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f7c641157a4cbe833dbaf9a963ca3d)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:13.461511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:13.512097 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f7c641157a4cbe833dbaf9a963ca3d', 'request_id': 'req-f409e50d-bf0e-494f-b670-22a1e75021fa'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.519567 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f7c641157a4cbe833dbaf9a963ca3d', 'request_id': 'req-f409e50d-bf0e-494f-b670-22a1e75021fa'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.525339 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f7c641157a4cbe833dbaf9a963ca3d', 'request_id': 'req-f409e50d-bf0e-494f-b670-22a1e75021fa'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.536460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] The token cache is being invalidate because project f0f7c641157a4cbe833dbaf9a963ca3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:13.536781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.537434 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.539041 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1360/2717] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:13 2022] DELETE /identity/v3/projects/f0f7c641157a4cbe833dbaf9a963ca3d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:13.543130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:13.544634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:13.557361 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec2de-713a-473e-be8e-e8806bc80b51 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:13.616540 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:13.617428 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:13.617713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:13.617986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] PATH_INFO: `/v3/users/15cabe471c8749d0bcab485a93f05ac2` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:13.619290 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cabe471c8749d0bcab485a93f05ac2)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:13.621226 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:13.670847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cabe471c8749d0bcab485a93f05ac2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.682215 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cabe471c8749d0bcab485a93f05ac2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.688857 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cabe471c8749d0bcab485a93f05ac2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.696607 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cabe471c8749d0bcab485a93f05ac2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.697303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cabe471c8749d0bcab485a93f05ac2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:13.703375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1358/2718] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:13 2022] DELETE /identity/v3/users/15cabe471c8749d0bcab485a93f05ac2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:13.902077 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:13.905212 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:13.918421 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409e50d-bf0e-494f-b670-22a1e75021fa admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:13.975635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:13.976586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:13.976870 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:13.977155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] PATH_INFO: `/v3/users/5e1ed642278642da9f9415ae2d5a2a5b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:13.978427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1ed642278642da9f9415ae2d5a2a5b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:13.980340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:13.990368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:13.995107 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.020480 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f00d40-c46f-4b65-a6dc-6ed3b3b99e1c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.025414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.026341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.026638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.026910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] PATH_INFO: `/v3/projects/1943c6389f5f42489ab328ed2aff4b73` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.028249 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1943c6389f5f42489ab328ed2aff4b73)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.030359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.032271 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1ed642278642da9f9415ae2d5a2a5b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.039600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1ed642278642da9f9415ae2d5a2a5b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.040353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1ed642278642da9f9415ae2d5a2a5b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.040939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1ed642278642da9f9415ae2d5a2a5b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.052403 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-0023bd3f-c8a5-474c-8c45-a69d652bfbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1ed642278642da9f9415ae2d5a2a5b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.066802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1361/2719] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:13 2022] DELETE /identity/v3/users/5e1ed642278642da9f9415ae2d5a2a5b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:14.078119 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1943c6389f5f42489ab328ed2aff4b73', 'request_id': 'req-8d0d032d-bccb-4757-bdbd-976467ba5db0'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.086911 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1943c6389f5f42489ab328ed2aff4b73', 'request_id': 'req-8d0d032d-bccb-4757-bdbd-976467ba5db0'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.092359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1943c6389f5f42489ab328ed2aff4b73', 'request_id': 'req-8d0d032d-bccb-4757-bdbd-976467ba5db0'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.103471 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] The token cache is being invalidate because project 1943c6389f5f42489ab328ed2aff4b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:14.103755 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.104386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-8d0d032d-bccb-4757-bdbd-976467ba5db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.105927 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1359/2720] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:13 2022] DELETE /identity/v3/projects/1943c6389f5f42489ab328ed2aff4b73 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:14.112239 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47adbbd-d82b-4b9c-aa1a-4ef66f4ef1bd None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.112922 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47adbbd-d82b-4b9c-aa1a-4ef66f4ef1bd None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.113202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47adbbd-d82b-4b9c-aa1a-4ef66f4ef1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.132925 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-b47adbbd-d82b-4b9c-aa1a-4ef66f4ef1bd None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:14.134145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b47adbbd-d82b-4b9c-aa1a-4ef66f4ef1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.191214 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1362/2721] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:14.201199 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.201460 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.201769 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.221703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:14.223041 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.233466 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1360/2722] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:14.238879 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47adbbd-d82b-4b9c-aa1a-4ef66f4ef1bd None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.240086 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.241544 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.248932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47adbbd-d82b-4b9c-aa1a-4ef66f4ef1bd None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.253668 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.253912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7ca1a-eae7-4a09-bf18-567eb9ffaae7 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.254388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.254669 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.255010 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.255755 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:14.256064 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.257760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.259196 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.260072 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.260358 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.260645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] PATH_INFO: `/v3/projects/5ccf0abcb5214c39a33b375f16d5f4ec` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.262567 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccf0abcb5214c39a33b375f16d5f4ec)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.264523 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.273635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1363/2723] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:01:14.274761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.284517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4d2d0-26ce-47df-ac45-328e6a0bef8f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.289193 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.290158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.290158 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.290416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.291164 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.293569 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.311501 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccf0abcb5214c39a33b375f16d5f4ec', 'request_id': 'req-6f5a36ad-3687-4dd6-a60c-d503081b054a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.319628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccf0abcb5214c39a33b375f16d5f4ec', 'request_id': 'req-6f5a36ad-3687-4dd6-a60c-d503081b054a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.321531 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1364/2724] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:14.325187 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccf0abcb5214c39a33b375f16d5f4ec', 'request_id': 'req-6f5a36ad-3687-4dd6-a60c-d503081b054a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.325453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.337362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] The token cache is being invalidate because project 5ccf0abcb5214c39a33b375f16d5f4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:14.337643 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.338318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.339987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1361/2725] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:14 2022] DELETE /identity/v3/projects/5ccf0abcb5214c39a33b375f16d5f4ec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:14.344077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.345392 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.384837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e605c-46b0-4560-9ffc-2f44376bc103 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.389379 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.390062 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.390371 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.390651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.391383 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.393291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.406240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a36ad-3687-4dd6-a60c-d503081b054a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.411223 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.412193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.412493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.412828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] PATH_INFO: `/v3/users/dcee798f36254283abac1cd0a4909e20` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.413908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcee798f36254283abac1cd0a4909e20)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.415892 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.419373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1365/2726] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:14.420605 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.422594 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.435101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848f34a-41f7-49f3-aee3-3fe2867522cb admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.440457 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.441183 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.441722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.442012 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.442945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.444892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.455769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1366/2727] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:14.460046 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.469494 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cac426-9c00-464b-87cf-75160d966aba admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.470167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcee798f36254283abac1cd0a4909e20'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.473901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.474636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.474915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.475189 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.475910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.477475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.481781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcee798f36254283abac1cd0a4909e20'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.487435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1367/2728] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:01:14.488407 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcee798f36254283abac1cd0a4909e20'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.491207 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.497042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcee798f36254283abac1cd0a4909e20'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.497659 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-20ff0636-3f9b-4716-b195-b64e936b63d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcee798f36254283abac1cd0a4909e20'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.500747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f597e4-5ab3-41bb-8251-a7364a6aa90b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.503812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1362/2729] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:14 2022] DELETE /identity/v3/users/dcee798f36254283abac1cd0a4909e20 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:14.505607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.506653 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.506937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.507210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] PATH_INFO: `/v3/projects/eb9c8937b9fe443496265e00b91f8b43/users/cda209307113439fb19cae9318d8f097/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.522910 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9c8937b9fe443496265e00b91f8b43, user_id=cda209307113439fb19cae9318d8f097, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.525649 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.541202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1368/2730] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:14 2022] PUT /identity/v3/projects/eb9c8937b9fe443496265e00b91f8b43/users/cda209307113439fb19cae9318d8f097/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:14.552539 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.553026 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.553128 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.580111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] MFA Rules not processed for user `cda209307113439fb19cae9318d8f097`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:14.581322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.643634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1363/2731] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:14.655033 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.658720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.676319 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.677826 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.718544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3db57-4485-436e-bd4c-7467c115de57 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.722233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.722955 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.723314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.723648 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.732007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.733492 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.742391 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1369/2732] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:14.744869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be89933-4608-4bc1-a67f-3c444b22c825 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.749867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.750818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.751098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.751372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] PATH_INFO: `/v3/projects/2d1d6b33b5284b57a6e56dffbcd87b5a` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.752562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1d6b33b5284b57a6e56dffbcd87b5a)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.754664 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.767980 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.769397 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.783149 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f775b-84c3-4a91-af16-9d5d7045aa0c service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:14.789130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:14.790602 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.791063 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.791481 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] PATH_INFO: `/v3/users/cda209307113439fb19cae9318d8f097` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.793396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda209307113439fb19cae9318d8f097)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:14.796545 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:14.804663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1d6b33b5284b57a6e56dffbcd87b5a', 'request_id': 'req-70c3fd1d-74f5-4516-a015-734b26efc85a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.812582 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1d6b33b5284b57a6e56dffbcd87b5a', 'request_id': 'req-70c3fd1d-74f5-4516-a015-734b26efc85a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.818457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1d6b33b5284b57a6e56dffbcd87b5a', 'request_id': 'req-70c3fd1d-74f5-4516-a015-734b26efc85a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.830804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] The token cache is being invalidate because project 2d1d6b33b5284b57a6e56dffbcd87b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:14.831043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.831847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-70c3fd1d-74f5-4516-a015-734b26efc85a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.833427 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1364/2733] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:14 2022] DELETE /identity/v3/projects/2d1d6b33b5284b57a6e56dffbcd87b5a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:14.838463 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342ca2-9a3f-40f5-9250-56b90c365105 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.838778 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342ca2-9a3f-40f5-9250-56b90c365105 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.839067 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342ca2-9a3f-40f5-9250-56b90c365105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.846678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda209307113439fb19cae9318d8f097'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.853651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda209307113439fb19cae9318d8f097'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.854427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda209307113439fb19cae9318d8f097'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.855104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda209307113439fb19cae9318d8f097'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.857016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f0342ca2-9a3f-40f5-9250-56b90c365105 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:14.858246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f0342ca2-9a3f-40f5-9250-56b90c365105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.866757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-e40162d9-e793-4fac-ba9d-211d54052a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda209307113439fb19cae9318d8f097'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:14.880165 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1370/2734] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:14 2022] DELETE /identity/v3/users/cda209307113439fb19cae9318d8f097 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:14.884508 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.884790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.885110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.902463 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:14.903702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.917334 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1365/2735] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:01:14.924878 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013e6f-797e-45ce-8bc6-665433ca68c4 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:14.925167 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013e6f-797e-45ce-8bc6-665433ca68c4 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:14.925438 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013e6f-797e-45ce-8bc6-665433ca68c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:14.944139 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-7b013e6f-797e-45ce-8bc6-665433ca68c4 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:14.945332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7b013e6f-797e-45ce-8bc6-665433ca68c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:14.961801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1371/2736] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:01:14.971333 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:14.972664 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:15.002889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1366/2737] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:01:15.007259 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013e6f-797e-45ce-8bc6-665433ca68c4 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.016195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013e6f-797e-45ce-8bc6-665433ca68c4 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.021968 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.023324 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.023601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.023903 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] PATH_INFO: `/v3/domains` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.024632 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86182) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:15.024933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.026590 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.029040 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f511f-3da2-43f6-ada6-8f6bbcd8c2a4 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.032595 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.033299 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.033511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.033779 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.038600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1367/2738] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 24 15:01:15.042796 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.043658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.045171 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.052181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63db55b-2268-40d2-bc13-9f0ab13fe061 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.055256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1372/2739] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:01:15.057184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.057850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.058166 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.058441 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.059155 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.061044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.090184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1368/2740] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:15.094315 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.104672 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3514-1289-4cb0-a8ae-2cd962fc92e2 service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.164998 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.165673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.165951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.166257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.166956 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.168917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.190355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1373/2741] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:15.194895 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.211749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e595-fbd2-4a50-b45b-1fe7abf59825 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.216915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.217597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.217902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.218209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.219200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.220805 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.231661 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1369/2742] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:15.240512 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.250797 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783192a7-ace0-4145-8e63-e59cce261235 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.255656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.256394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.256678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.256952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.257680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.259341 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.273175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1374/2743] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:15.274409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.284616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef544c-b49b-42d1-9471-847b3d551796 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.289239 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53e11-96b4-4405-af75-0f3467193d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.290191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53e11-96b4-4405-af75-0f3467193d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.290475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53e11-96b4-4405-af75-0f3467193d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.290752 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53e11-96b4-4405-af75-0f3467193d11 admin admin] PATH_INFO: `/v3/projects/5fb9fd230f3449169fd1467f073aa072/users/50bec8c8feba432caa3eee4a7325921b/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.307898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53e11-96b4-4405-af75-0f3467193d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb9fd230f3449169fd1467f073aa072, user_id=50bec8c8feba432caa3eee4a7325921b, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.310727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53e11-96b4-4405-af75-0f3467193d11 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.326907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1370/2744] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:15 2022] PUT /identity/v3/projects/5fb9fd230f3449169fd1467f073aa072/users/50bec8c8feba432caa3eee4a7325921b/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:15.335689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.337371 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f42534-ecff-43bb-8a78-efbfac2561a3 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.337663 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f42534-ecff-43bb-8a78-efbfac2561a3 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.337936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:15.338048 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f42534-ecff-43bb-8a78-efbfac2561a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.361417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95122-781b-416b-8de7-b8b968f76b14 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.366660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-f0f42534-ecff-43bb-8a78-efbfac2561a3 None None] MFA Rules not processed for user `50bec8c8feba432caa3eee4a7325921b`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:15.368130 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-f0f42534-ecff-43bb-8a78-efbfac2561a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:15.416958 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.417962 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.418282 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.418561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] PATH_INFO: `/v3/projects/eb9c8937b9fe443496265e00b91f8b43` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.419757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9c8937b9fe443496265e00b91f8b43)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.421677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.428446 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1371/2745] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:01:15.432944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f42534-ecff-43bb-8a78-efbfac2561a3 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.442850 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f42534-ecff-43bb-8a78-efbfac2561a3 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.447690 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.448330 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.448610 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.448881 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.449637 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.451704 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.470832 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9c8937b9fe443496265e00b91f8b43', 'request_id': 'req-8bb5c672-066f-4424-829a-6f6e5776b37e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:15.479982 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9c8937b9fe443496265e00b91f8b43', 'request_id': 'req-8bb5c672-066f-4424-829a-6f6e5776b37e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:15.482142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1372/2746] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:15.486440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9c8937b9fe443496265e00b91f8b43', 'request_id': 'req-8bb5c672-066f-4424-829a-6f6e5776b37e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:15.486573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.500475 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] The token cache is being invalidate because project eb9c8937b9fe443496265e00b91f8b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:15.500753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:15.501816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:15.503353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1375/2747] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:15 2022] DELETE /identity/v3/projects/eb9c8937b9fe443496265e00b91f8b43 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:15.551697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48a083-68d7-4b2a-b71e-3a2f24e835f5 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.557512 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.558287 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.558557 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.558829 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.559535 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.561616 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.585534 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1373/2748] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:15.589901 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.591502 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:15.661150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c672-066f-4424-829a-6f6e5776b37e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.666340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.667038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.667312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.667586 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.668360 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.669951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.680532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1376/2749] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:15.684797 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.696302 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08fc0b-db5c-40f5-bacd-509c491faad4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.701545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467a78d-a7eb-470f-b7bd-43b44ec8b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.702385 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a78d-a7eb-470f-b7bd-43b44ec8b52b admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.702753 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a78d-a7eb-470f-b7bd-43b44ec8b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.703092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a78d-a7eb-470f-b7bd-43b44ec8b52b admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.703839 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467a78d-a7eb-470f-b7bd-43b44ec8b52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.705848 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467a78d-a7eb-470f-b7bd-43b44ec8b52b admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.717126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1374/2750] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:15.721587 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.731963 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2021488-b9ea-4367-8bca-0f21c2e34fe8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.736804 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.737734 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] REQUEST_METHOD: `PUT` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.738008 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.738314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] PATH_INFO: `/v3/projects/02be0af0085544c6b8f86afe7d0461b5/users/cfb67e390fd542a183eee04d77ebe901/roles/610442154bc84cae961360db5432b95b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.754613 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02be0af0085544c6b8f86afe7d0461b5, user_id=cfb67e390fd542a183eee04d77ebe901, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.757323 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.772534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1377/2751] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:15 2022] PUT /identity/v3/projects/02be0af0085544c6b8f86afe7d0461b5/users/cfb67e390fd542a183eee04d77ebe901/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:15.782821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe30958-7221-48a8-a201-9f70e87a8e0e None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.783108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe30958-7221-48a8-a201-9f70e87a8e0e None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.783381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe30958-7221-48a8-a201-9f70e87a8e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.809542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-dbe30958-7221-48a8-a201-9f70e87a8e0e None None] MFA Rules not processed for user `cfb67e390fd542a183eee04d77ebe901`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:15.810688 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-dbe30958-7221-48a8-a201-9f70e87a8e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:15.879040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1375/2752] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:15.883665 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.943363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f13e8-7f66-479c-b023-835d65276196 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:15.948233 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:15.948892 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:15.949173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:15.949451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:15.950146 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:15.952044 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:15.979029 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1378/2753] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:15.983338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe30958-7221-48a8-a201-9f70e87a8e0e None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:15.994015 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe30958-7221-48a8-a201-9f70e87a8e0e None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:16.054694 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:16.055583 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:16.055934 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:16.056297 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:16.057382 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:16.060477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:16.086882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1376/2754] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:15 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:16.090978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:16.101537 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7899c85-491f-4a86-9383-d145f664be9e admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:16.106992 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:16.107651 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:16.107933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:16.108210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:16.108937 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:16.110592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:16.121769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1379/2755] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:16.126040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:16.136573 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01f4f-8173-49cd-8d8f-29e9c5465293 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:16.142622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:16.143496 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:16.143827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:16.144061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] PATH_INFO: `/v3/projects/e4278986fdc544f1b9f9be67b56d680c/users/693838f39ca2452fa440ea7ee42432c6/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:16.159939 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4278986fdc544f1b9f9be67b56d680c, user_id=693838f39ca2452fa440ea7ee42432c6, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:16.162719 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:16.178307 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1377/2756] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:16 2022] PUT /identity/v3/projects/e4278986fdc544f1b9f9be67b56d680c/users/693838f39ca2452fa440ea7ee42432c6/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 24 15:01:16.182490 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:16.192791 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4327beb-a0e4-452c-aa3b-89e80058fea3 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:16.252634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04503-94f8-4cd6-9cc3-78cc21282b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:16.253290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04503-94f8-4cd6-9cc3-78cc21282b9d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:16.253592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04503-94f8-4cd6-9cc3-78cc21282b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:16.253852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04503-94f8-4cd6-9cc3-78cc21282b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:16.254606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04503-94f8-4cd6-9cc3-78cc21282b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:16.256306 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04503-94f8-4cd6-9cc3-78cc21282b9d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:16.266320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1380/2757] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:16.270671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:16.281625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffdb97-7d34-4f57-8b20-979801e6d54f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:16.287003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:16.287884 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:16.288162 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:16.288434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] PATH_INFO: `/v3/projects/e4278986fdc544f1b9f9be67b56d680c/users/693838f39ca2452fa440ea7ee42432c6/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:16.290597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4278986fdc544f1b9f9be67b56d680c, user_id=693838f39ca2452fa440ea7ee42432c6, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:16.293272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:16.303822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1378/2758] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:16 2022] PUT /identity/v3/projects/e4278986fdc544f1b9f9be67b56d680c/users/693838f39ca2452fa440ea7ee42432c6/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:16.314284 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a86f1-eff9-40ec-9386-89b5edbaa5c1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:16.314509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a86f1-eff9-40ec-9386-89b5edbaa5c1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:16.314782 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a86f1-eff9-40ec-9386-89b5edbaa5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:16.345374 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-e23a86f1-eff9-40ec-9386-89b5edbaa5c1 None None] MFA Rules not processed for user `693838f39ca2452fa440ea7ee42432c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:16.347072 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-e23a86f1-eff9-40ec-9386-89b5edbaa5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:16.420659 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1381/2759] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:16.432749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:16.435085 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:16.493828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a541c-c5e0-4d8b-8ebd-ed8ba1d050f4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:16.497867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:16.498537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:16.498837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:16.499093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:16.500936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:16.561191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:16.562671 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:16.571724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1379/2760] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:18.063420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a86f1-eff9-40ec-9386-89b5edbaa5c1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:18.074729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a86f1-eff9-40ec-9386-89b5edbaa5c1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:18.078931 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:18.079933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:18.080221 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:18.080498 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:18.144422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:18.145874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:18.154907 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1382/2761] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:18.709098 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:18.718505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a050a-6776-4116-8f52-9665f1495027 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:18.723040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d84e83-ae87-4b01-b598-f7597fbb1713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:18.723701 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d84e83-ae87-4b01-b598-f7597fbb1713 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:18.723978 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d84e83-ae87-4b01-b598-f7597fbb1713 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:18.724248 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d84e83-ae87-4b01-b598-f7597fbb1713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:18.733915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d84e83-ae87-4b01-b598-f7597fbb1713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:18.735426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d84e83-ae87-4b01-b598-f7597fbb1713 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:18.745897 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1380/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:22.777741 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:22.842519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6544-fd67-4d71-8772-be00c938bb05 service cinder] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:22.848617 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:22.849493 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:22.849775 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:22.850048 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] PATH_INFO: `/v3/users/50bec8c8feba432caa3eee4a7325921b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:22.851373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bec8c8feba432caa3eee4a7325921b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:22.853264 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:22.911557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bec8c8feba432caa3eee4a7325921b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:22.919554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bec8c8feba432caa3eee4a7325921b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:22.920307 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bec8c8feba432caa3eee4a7325921b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:22.921142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bec8c8feba432caa3eee4a7325921b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:22.933986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bec8c8feba432caa3eee4a7325921b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:22.948446 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1383/2763] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:22 2022] DELETE /identity/v3/users/50bec8c8feba432caa3eee4a7325921b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:22.953181 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:22.953668 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:22.953786 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:22.971332 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:22.972437 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:23.039887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1381/2764] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:23.049989 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:23.051738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:23.112380 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e2d9-b733-4821-b1eb-0cc1e767fe0d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:23.117086 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:23.117730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:23.118013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:23.118355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:23.128698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:23.130336 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:23.141045 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1384/2765] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:23.457227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:23.458947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:23.481703 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e861f1-0669-43eb-b373-15d57c6e72ac None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:23.488946 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:23.489809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:23.490127 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:23.490416 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] PATH_INFO: `/v3/projects/5fb9fd230f3449169fd1467f073aa072` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:23.491651 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb9fd230f3449169fd1467f073aa072)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:23.493636 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:23.549640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb9fd230f3449169fd1467f073aa072', 'request_id': 'req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.557123 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb9fd230f3449169fd1467f073aa072', 'request_id': 'req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.563645 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb9fd230f3449169fd1467f073aa072', 'request_id': 'req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.575485 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] The token cache is being invalidate because project 5fb9fd230f3449169fd1467f073aa072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:23.576405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.577065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.578708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1382/2766] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:23 2022] DELETE /identity/v3/projects/5fb9fd230f3449169fd1467f073aa072 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:23.584326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:23.595296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe47c0-b7a4-4fa9-9037-9bcf9ecc45ed service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:23.656014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:23.656951 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:23.657236 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:23.657513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] PATH_INFO: `/v3/users/cfb67e390fd542a183eee04d77ebe901` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:23.658844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb67e390fd542a183eee04d77ebe901)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:23.660790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:23.710480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb67e390fd542a183eee04d77ebe901'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.717352 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb67e390fd542a183eee04d77ebe901'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.718047 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb67e390fd542a183eee04d77ebe901'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.718712 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb67e390fd542a183eee04d77ebe901'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.730766 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb67e390fd542a183eee04d77ebe901'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:23.746191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1385/2767] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:23 2022] DELETE /identity/v3/users/cfb67e390fd542a183eee04d77ebe901 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:24.032953 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:24.034578 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:24.048206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b5bc-33e7-4cee-8349-5c2e14ef5a2a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:24.106183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:24.106986 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:24.107271 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:24.107546 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] PATH_INFO: `/v3/projects/02be0af0085544c6b8f86afe7d0461b5` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:24.108723 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02be0af0085544c6b8f86afe7d0461b5)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:24.110672 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:24.161311 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02be0af0085544c6b8f86afe7d0461b5', 'request_id': 'req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.171482 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02be0af0085544c6b8f86afe7d0461b5', 'request_id': 'req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.177792 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02be0af0085544c6b8f86afe7d0461b5', 'request_id': 'req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.189511 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] The token cache is being invalidate because project 02be0af0085544c6b8f86afe7d0461b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:24.189871 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.190585 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.192185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1383/2768] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:24 2022] DELETE /identity/v3/projects/02be0af0085544c6b8f86afe7d0461b5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:24.196912 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:24.198451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:24.213510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35815265-782e-473a-95f5-1367e5cd0681 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:24.277354 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:24.278708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:24.278920 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:24.279313 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] PATH_INFO: `/v3/users/693838f39ca2452fa440ea7ee42432c6` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:24.281145 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693838f39ca2452fa440ea7ee42432c6)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:24.283437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:24.333529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693838f39ca2452fa440ea7ee42432c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.340660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693838f39ca2452fa440ea7ee42432c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.341415 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693838f39ca2452fa440ea7ee42432c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.342107 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693838f39ca2452fa440ea7ee42432c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.354692 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-f829a0c0-4e1c-4385-90bb-902f8d458277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693838f39ca2452fa440ea7ee42432c6'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.370861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1386/2769] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:24 2022] DELETE /identity/v3/users/693838f39ca2452fa440ea7ee42432c6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:24.649933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:24.651477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:24.665150 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc72f0e-c2c0-48b0-8d53-92fb4af24199 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:24.726683 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:24.727556 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:24.727837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:24.728113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] PATH_INFO: `/v3/projects/e4278986fdc544f1b9f9be67b56d680c` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:24.729433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4278986fdc544f1b9f9be67b56d680c)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:24.731692 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:24.779456 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4278986fdc544f1b9f9be67b56d680c', 'request_id': 'req-bf655c65-4333-421f-ba65-c3188ebc1b21'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.786932 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4278986fdc544f1b9f9be67b56d680c', 'request_id': 'req-bf655c65-4333-421f-ba65-c3188ebc1b21'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.792624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4278986fdc544f1b9f9be67b56d680c', 'request_id': 'req-bf655c65-4333-421f-ba65-c3188ebc1b21'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.804316 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] The token cache is being invalidate because project e4278986fdc544f1b9f9be67b56d680c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:24.804624 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.805303 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-bf655c65-4333-421f-ba65-c3188ebc1b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:24.806947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1384/2770] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:24 2022] DELETE /identity/v3/projects/e4278986fdc544f1b9f9be67b56d680c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:24.812489 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550224-0f66-43ed-a61e-41d33bd5833a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:24.812802 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550224-0f66-43ed-a61e-41d33bd5833a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:24.813133 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550224-0f66-43ed-a61e-41d33bd5833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:24.837961 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-0b550224-0f66-43ed-a61e-41d33bd5833a None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:24.839226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-0b550224-0f66-43ed-a61e-41d33bd5833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:24.903115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1387/2771] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:24.911088 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afa4a6-d950-4956-a434-e4478b32dcab None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:24.911419 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afa4a6-d950-4956-a434-e4478b32dcab None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:24.911682 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afa4a6-d950-4956-a434-e4478b32dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:24.930524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-55afa4a6-d950-4956-a434-e4478b32dcab None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:24.931726 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-55afa4a6-d950-4956-a434-e4478b32dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:24.940040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1385/2772] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:01:24.944422 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b550224-0f66-43ed-a61e-41d33bd5833a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:24.954507 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b550224-0f66-43ed-a61e-41d33bd5833a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:24.959778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:24.960448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:24.960738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:24.961016 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:24.961764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:24.962071 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:24.963711 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:24.975764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1388/2773] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:01:24.980352 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afa4a6-d950-4956-a434-e4478b32dcab None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:24.990056 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afa4a6-d950-4956-a434-e4478b32dcab None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:24.994980 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:24.995642 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:24.995926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:24.996201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:24.996923 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:24.998906 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:25.028270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1386/2774] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:24 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:01:25.032864 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:25.042906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7a73-27e2-45b5-86b6-174b6d94a96d admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:25.099248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:25.099944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:25.100218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:25.100506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:25.101199 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:25.103192 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:25.130786 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1389/2775] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:25 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:25.132213 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:25.143318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85249dc3-5d72-45a5-b928-cf4df2cee558 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:25.148746 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:25.149409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:25.149725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:25.149974 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:25.150739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:25.152545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:25.164192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1387/2776] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:25.168346 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:25.179025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecdd18-4052-41a4-8455-90d1d331f34f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:25.184673 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43821da7-b4e6-4899-9866-fc9943f9bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:25.185353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821da7-b4e6-4899-9866-fc9943f9bc28 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:25.185637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821da7-b4e6-4899-9866-fc9943f9bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:25.185913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43821da7-b4e6-4899-9866-fc9943f9bc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:25.186693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43821da7-b4e6-4899-9866-fc9943f9bc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:25.188305 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43821da7-b4e6-4899-9866-fc9943f9bc28 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:25.198911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1390/2777] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:25.203374 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:25.214333 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54007cc-5f24-4a72-bd9f-033995872d38 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:25.219564 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:25.220435 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:25.220821 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:25.221151 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] PATH_INFO: `/v3/projects/41c92cc7089143c89e60e178d66c2a45/users/96e7930d826e4dc0a8279a6a9655381f/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:25.236018 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c92cc7089143c89e60e178d66c2a45, user_id=96e7930d826e4dc0a8279a6a9655381f, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:25.238718 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:25.253882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1388/2778] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:25 2022] PUT /identity/v3/projects/41c92cc7089143c89e60e178d66c2a45/users/96e7930d826e4dc0a8279a6a9655381f/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:25.264886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d562-f754-463c-b263-c69eeac8aba1 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:25.265178 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d562-f754-463c-b263-c69eeac8aba1 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:25.265542 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1d562-f754-463c-b263-c69eeac8aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:25.292935 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-88d1d562-f754-463c-b263-c69eeac8aba1 None None] MFA Rules not processed for user `96e7930d826e4dc0a8279a6a9655381f`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:25.294272 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-88d1d562-f754-463c-b263-c69eeac8aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:25.373229 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1391/2779] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:25.385164 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:25.387395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:25.451011 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c524c3-9027-4aeb-889e-369e250f0ff3 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:25.456126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec201f0-1ffd-4fb2-94e1-10d0251dff74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:25.456782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec201f0-1ffd-4fb2-94e1-10d0251dff74 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:25.457065 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec201f0-1ffd-4fb2-94e1-10d0251dff74 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:25.457321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec201f0-1ffd-4fb2-94e1-10d0251dff74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:25.466638 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec201f0-1ffd-4fb2-94e1-10d0251dff74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:25.468363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec201f0-1ffd-4fb2-94e1-10d0251dff74 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:25.478627 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1389/2780] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:28.026471 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d562-f754-463c-b263-c69eeac8aba1 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:28.096051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1d562-f754-463c-b263-c69eeac8aba1 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:28.101285 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:28.102180 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.102461 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.102732 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] PATH_INFO: `/v3/users/96e7930d826e4dc0a8279a6a9655381f` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.103995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e7930d826e4dc0a8279a6a9655381f)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:28.105997 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:28.154287 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e7930d826e4dc0a8279a6a9655381f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.162555 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e7930d826e4dc0a8279a6a9655381f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.163290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e7930d826e4dc0a8279a6a9655381f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.163913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e7930d826e4dc0a8279a6a9655381f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.176017 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e7930d826e4dc0a8279a6a9655381f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.191117 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1392/2781] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:28 2022] DELETE /identity/v3/users/96e7930d826e4dc0a8279a6a9655381f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:28.198916 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.199433 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.199555 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.217992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:28.219237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:28.277413 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1390/2782] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:28.288014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:28.289482 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:28.356590 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5a24c-93f6-4515-9285-5f5a2b8f44ae admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:28.360863 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ce118-d25b-4ac5-8ad2-06d189dabc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:28.361532 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ce118-d25b-4ac5-8ad2-06d189dabc2c service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.361819 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ce118-d25b-4ac5-8ad2-06d189dabc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.362646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ce118-d25b-4ac5-8ad2-06d189dabc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.372625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ce118-d25b-4ac5-8ad2-06d189dabc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:28.374114 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ce118-d25b-4ac5-8ad2-06d189dabc2c service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:28.384034 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1393/2783] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:01:28.653917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:28.655548 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:28.672887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae811c-0e0b-49c4-839f-155d29137d18 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:28.678673 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:28.679612 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.679861 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.680138 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] PATH_INFO: `/v3/projects/41c92cc7089143c89e60e178d66c2a45` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.681380 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c92cc7089143c89e60e178d66c2a45)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:28.683421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:28.734189 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c92cc7089143c89e60e178d66c2a45', 'request_id': 'req-26b5c6db-4dd0-465d-8e07-21c5160660a3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.743517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c92cc7089143c89e60e178d66c2a45', 'request_id': 'req-26b5c6db-4dd0-465d-8e07-21c5160660a3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.749605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c92cc7089143c89e60e178d66c2a45', 'request_id': 'req-26b5c6db-4dd0-465d-8e07-21c5160660a3'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.761061 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] The token cache is being invalidate because project 41c92cc7089143c89e60e178d66c2a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:28.761346 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.761988 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-26b5c6db-4dd0-465d-8e07-21c5160660a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:28.763997 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1391/2784] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:28 2022] DELETE /identity/v3/projects/41c92cc7089143c89e60e178d66c2a45 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:28.769151 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691263-3356-4e57-a2a2-ab0e14ae48c7 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.769440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691263-3356-4e57-a2a2-ab0e14ae48c7 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.769712 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691263-3356-4e57-a2a2-ab0e14ae48c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.787630 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-f9691263-3356-4e57-a2a2-ab0e14ae48c7 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:28.788817 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-f9691263-3356-4e57-a2a2-ab0e14ae48c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:28.849967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1394/2785] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:28.858981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240357bf-925b-4222-94cf-858182217aca None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.859292 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240357bf-925b-4222-94cf-858182217aca None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.859562 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240357bf-925b-4222-94cf-858182217aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.878950 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-240357bf-925b-4222-94cf-858182217aca None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:28.880159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-240357bf-925b-4222-94cf-858182217aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:28.889201 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1392/2786] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:28.893702 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691263-3356-4e57-a2a2-ab0e14ae48c7 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:28.903694 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691263-3356-4e57-a2a2-ab0e14ae48c7 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:28.908762 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:28.909418 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.909703 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.909977 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.910751 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:28.911056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:28.912677 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:28.924123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1395/2787] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:01:28.928890 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240357bf-925b-4222-94cf-858182217aca None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:28.939372 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240357bf-925b-4222-94cf-858182217aca None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:28.945253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:28.945912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:28.946241 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:28.946509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:28.947206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:28.949101 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:28.979272 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1393/2788] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:28 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:28.983292 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:28.993803 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672099ee-9a78-41c3-b3b6-2a07212e8786 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:29.053238 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:29.053939 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:29.054211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:29.054485 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:29.055173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:29.057101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:29.079945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1396/2789] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:28 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:29.084457 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:29.095275 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e96a76-b79a-413a-a1f9-7237287027b4 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:29.100527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:29.101246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:29.101550 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:29.101818 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:29.102920 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:29.104867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:29.116605 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1394/2790] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:29.120908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:29.131308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95aa1e-f49f-40ed-b9f4-d36d098417f8 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:29.137363 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282fdbe-8993-4657-9962-f19326cc0096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:29.138110 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fdbe-8993-4657-9962-f19326cc0096 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:29.138396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fdbe-8993-4657-9962-f19326cc0096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:29.138670 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fdbe-8993-4657-9962-f19326cc0096 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:29.139410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282fdbe-8993-4657-9962-f19326cc0096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:29.141069 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282fdbe-8993-4657-9962-f19326cc0096 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:29.152118 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1397/2791] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:29.156713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:29.167757 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3582-a237-4888-b3cf-18e691079f58 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:29.173402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:29.174340 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:29.174619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:29.174898 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] PATH_INFO: `/v3/projects/2521ecc6188e4d778b376fa94ac949f4/users/0e054e5e89fa4c3eacac5434098645d9/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:29.191325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2521ecc6188e4d778b376fa94ac949f4, user_id=0e054e5e89fa4c3eacac5434098645d9, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:29.194108 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:29.211208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1395/2792] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:29 2022] PUT /identity/v3/projects/2521ecc6188e4d778b376fa94ac949f4/users/0e054e5e89fa4c3eacac5434098645d9/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:29.221279 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:29.221689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:29.221975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:29.249429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] MFA Rules not processed for user `0e054e5e89fa4c3eacac5434098645d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:29.250689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:29.314754 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1398/2793] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:29.326545 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:29.328596 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:29.396947 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83436a-339f-4242-aca6-63d2332704c2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:29.401992 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac3221-9691-43b4-afbe-74fedde875a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:29.402691 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac3221-9691-43b4-afbe-74fedde875a7 service glance] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:29.402966 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac3221-9691-43b4-afbe-74fedde875a7 service glance] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:29.403238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac3221-9691-43b4-afbe-74fedde875a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:29.412597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac3221-9691-43b4-afbe-74fedde875a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:29.414055 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac3221-9691-43b4-afbe-74fedde875a7 service glance] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:29.423529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1396/2794] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:44.773099 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:44.774730 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:44.840401 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558928b-bf3f-460d-b5e8-061699fd6414 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:44.845290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:44.846202 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:44.846486 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:44.846770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] PATH_INFO: `/v3/users/8936f25f5dac408fa1ae4eb9d10dd10f` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:44.847995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8936f25f5dac408fa1ae4eb9d10dd10f)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:44.849917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:44.897639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8936f25f5dac408fa1ae4eb9d10dd10f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:44.905295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8936f25f5dac408fa1ae4eb9d10dd10f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:44.906002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8936f25f5dac408fa1ae4eb9d10dd10f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:44.906636 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8936f25f5dac408fa1ae4eb9d10dd10f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:44.918314 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8936f25f5dac408fa1ae4eb9d10dd10f'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:44.931970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1399/2795] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:44 2022] DELETE /identity/v3/users/8936f25f5dac408fa1ae4eb9d10dd10f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:44.936689 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115e066-963a-4add-b833-8a023c233f28 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:44.937200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115e066-963a-4add-b833-8a023c233f28 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:44.937368 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115e066-963a-4add-b833-8a023c233f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:44.954915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-8115e066-963a-4add-b833-8a023c233f28 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:44.956118 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8115e066-963a-4add-b833-8a023c233f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:45.019444 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1397/2796] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:45.029544 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.031098 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:45.090143 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041fd8e-44fb-4e70-9dd1-80784dcd909c admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.094517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c13347-0964-4f8d-be54-4e120d49f55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.095172 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13347-0964-4f8d-be54-4e120d49f55b service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.095453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13347-0964-4f8d-be54-4e120d49f55b service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.095731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c13347-0964-4f8d-be54-4e120d49f55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.106844 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c13347-0964-4f8d-be54-4e120d49f55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.109153 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c13347-0964-4f8d-be54-4e120d49f55b service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.122758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1400/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:45.400475 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115e066-963a-4add-b833-8a023c233f28 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.401940 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-8115e066-963a-4add-b833-8a023c233f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:45.414298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115e066-963a-4add-b833-8a023c233f28 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.419601 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.420489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.420780 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.421059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] PATH_INFO: `/v3/projects/f43e643761c14728b9088883cffb5f06` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.422362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43e643761c14728b9088883cffb5f06)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.424327 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.478580 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43e643761c14728b9088883cffb5f06', 'request_id': 'req-e11619fd-476e-47b9-a36e-965921fa8ef9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:45.489137 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43e643761c14728b9088883cffb5f06', 'request_id': 'req-e11619fd-476e-47b9-a36e-965921fa8ef9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:45.495216 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43e643761c14728b9088883cffb5f06', 'request_id': 'req-e11619fd-476e-47b9-a36e-965921fa8ef9'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:45.506037 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] The token cache is being invalidate because project f43e643761c14728b9088883cffb5f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:45.506347 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:45.506987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-e11619fd-476e-47b9-a36e-965921fa8ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:45.508539 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1398/2798] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:45 2022] DELETE /identity/v3/projects/f43e643761c14728b9088883cffb5f06 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:45.515316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd2a5-7765-4173-9f34-52cea8738916 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.515601 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd2a5-7765-4173-9f34-52cea8738916 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.515873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd2a5-7765-4173-9f34-52cea8738916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.534735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-657dd2a5-7765-4173-9f34-52cea8738916 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:45.535918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-657dd2a5-7765-4173-9f34-52cea8738916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:45.596757 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1401/2799] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:45.605063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcdf7-d9ea-4ebd-bb7a-15d96a1d73ba None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.605421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcdf7-d9ea-4ebd-bb7a-15d96a1d73ba None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.605724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bcdf7-d9ea-4ebd-bb7a-15d96a1d73ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.625478 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ad5bcdf7-d9ea-4ebd-bb7a-15d96a1d73ba None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:45.626717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ad5bcdf7-d9ea-4ebd-bb7a-15d96a1d73ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:45.635281 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1399/2800] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:45.639671 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd2a5-7765-4173-9f34-52cea8738916 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.649707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd2a5-7765-4173-9f34-52cea8738916 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.655248 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.655909 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.656213 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.656474 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.657218 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:45.657524 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.659406 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.670968 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1402/2801] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:01:45.675509 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcdf7-d9ea-4ebd-bb7a-15d96a1d73ba None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.685265 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bcdf7-d9ea-4ebd-bb7a-15d96a1d73ba None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.690293 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.691019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.691362 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.691696 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.692450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.694464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.724040 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1400/2802] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:45 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:45.728510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.738814 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a015c43-5727-44cd-961e-dcab20e127b2 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.797312 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.797985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.798298 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.798582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.799291 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.801215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.826487 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1403/2803] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:45 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:45.831126 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.841972 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5086e4-fd70-41eb-9574-1f91c9e8244a admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.847211 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.847910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.848191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.848462 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.849195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.850965 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.862059 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1401/2804] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:45.866262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.876554 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a604cd1-1ad9-42fb-9540-686d88435785 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.881957 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c726ed-f34c-4390-9a83-0d25e058d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.882780 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c726ed-f34c-4390-9a83-0d25e058d292 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.883080 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c726ed-f34c-4390-9a83-0d25e058d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.883355 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c726ed-f34c-4390-9a83-0d25e058d292 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.884087 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c726ed-f34c-4390-9a83-0d25e058d292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.885690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c726ed-f34c-4390-9a83-0d25e058d292 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.895911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1404/2805] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:45.900157 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:45.910445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69171619-fb63-40ce-8d55-2baf7bb2bd33 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:45.915322 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:45.916205 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.916481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.916758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] PATH_INFO: `/v3/projects/24a82f9d03544309b0db5474390e9669/users/df4e425ec5564f27a0825867e7543366/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.931498 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a82f9d03544309b0db5474390e9669, user_id=df4e425ec5564f27a0825867e7543366, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:45.934124 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:45.949280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1402/2806] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:45 2022] PUT /identity/v3/projects/24a82f9d03544309b0db5474390e9669/users/df4e425ec5564f27a0825867e7543366/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:45.960043 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81db28-4f33-4f83-adc8-43cab736212f None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:45.960390 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81db28-4f33-4f83-adc8-43cab736212f None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:45.960639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81db28-4f33-4f83-adc8-43cab736212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:45.988192 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-aa81db28-4f33-4f83-adc8-43cab736212f None None] MFA Rules not processed for user `df4e425ec5564f27a0825867e7543366`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:45.989480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-aa81db28-4f33-4f83-adc8-43cab736212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:46.060042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1405/2807] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:46.073787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:46.076009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:46.135113 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656691d-2944-415a-a972-c6f6b174b0fa admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:46.139231 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:46.139875 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:46.140154 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:46.140421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:46.148949 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:46.150405 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:46.159145 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1403/2808] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:47.511269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:47.511824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:47.511824 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:47.532568 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] MFA Rules not processed for user `df4e425ec5564f27a0825867e7543366`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:47.533790 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:47.542427 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1406/2809] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:48.470902 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:48.472575 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:48.545670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3389fa-3767-441c-9474-b5ffe848edf3 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:48.551845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60359e-a93f-43c0-9761-968cf036a758 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca33f2f8bb0a4631912f0ed51c6f8c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:48.552491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60359e-a93f-43c0-9761-968cf036a758 service placement] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:48.552766 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60359e-a93f-43c0-9761-968cf036a758 service placement] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:48.553039 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60359e-a93f-43c0-9761-968cf036a758 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:48.555036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-6a60359e-a93f-43c0-9761-968cf036a758 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:48.567298 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60359e-a93f-43c0-9761-968cf036a758 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:48.568928 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60359e-a93f-43c0-9761-968cf036a758 service placement] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:48.579524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1404/2810] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:58.347169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:58.348831 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:58.416123 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621188-ae67-4b1f-9a02-2b93ae9908a4 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:58.420778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:58.421816 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:58.422116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:58.422409 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] PATH_INFO: `/v3/users/0e054e5e89fa4c3eacac5434098645d9` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:58.423588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e054e5e89fa4c3eacac5434098645d9)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:58.425631 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:58.474852 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e054e5e89fa4c3eacac5434098645d9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:58.482226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e054e5e89fa4c3eacac5434098645d9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:58.482917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e054e5e89fa4c3eacac5434098645d9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:58.483519 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e054e5e89fa4c3eacac5434098645d9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:58.495161 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e054e5e89fa4c3eacac5434098645d9'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:58.509950 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1407/2811] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:01:58 2022] DELETE /identity/v3/users/0e054e5e89fa4c3eacac5434098645d9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:58.514724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:58.515238 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:58.515343 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:58.532788 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:58.534111 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:58.594253 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1405/2812] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:58.604081 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:58.605770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:58.663725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf2d4e-8987-4b7c-be2e-4535166a6691 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:58.668708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5bfe-7023-463f-9432-00e4f160f607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:58.669431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5bfe-7023-463f-9432-00e4f160f607 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:58.669691 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5bfe-7023-463f-9432-00e4f160f607 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:58.669966 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5bfe-7023-463f-9432-00e4f160f607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:58.679857 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5bfe-7023-463f-9432-00e4f160f607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:58.681408 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5bfe-7023-463f-9432-00e4f160f607 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:58.691713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1408/2813] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:01:58.966380 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:58.967804 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:58.979510 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889b29-2c63-49b3-a81e-add114ee1663 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:58.984773 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:58.985649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:58.985910 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:58.986193 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] PATH_INFO: `/v3/projects/2521ecc6188e4d778b376fa94ac949f4` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:58.987402 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2521ecc6188e4d778b376fa94ac949f4)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:58.989309 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.035257 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2521ecc6188e4d778b376fa94ac949f4', 'request_id': 'req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:59.043064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2521ecc6188e4d778b376fa94ac949f4', 'request_id': 'req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:59.048561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2521ecc6188e4d778b376fa94ac949f4', 'request_id': 'req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:59.059528 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] The token cache is being invalidate because project 2521ecc6188e4d778b376fa94ac949f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:01:59.059838 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:59.060489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-81df6089-d2fa-42ed-8149-5bfd8da5ea9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:01:59.062023 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1406/2814] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:01:58 2022] DELETE /identity/v3/projects/2521ecc6188e4d778b376fa94ac949f4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:59.067130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8be4-b588-435d-954e-383d0860d950 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.067500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8be4-b588-435d-954e-383d0860d950 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.067783 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8be4-b588-435d-954e-383d0860d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.085500 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-04dc8be4-b588-435d-954e-383d0860d950 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:59.086698 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-04dc8be4-b588-435d-954e-383d0860d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:59.146713 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1409/2815] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:01:59.155077 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6bdcd-46e8-450a-a4a2-3b08d8b7b37d None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.155359 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6bdcd-46e8-450a-a4a2-3b08d8b7b37d None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.155628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6bdcd-46e8-450a-a4a2-3b08d8b7b37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.175314 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-2dc6bdcd-46e8-450a-a4a2-3b08d8b7b37d None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:59.176505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2dc6bdcd-46e8-450a-a4a2-3b08d8b7b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:59.185629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1407/2816] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:59.189874 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8be4-b588-435d-954e-383d0860d950 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:59.200083 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8be4-b588-435d-954e-383d0860d950 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:59.206285 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:59.206965 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.207249 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.207517 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.208269 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:01:59.208616 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:59.210290 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.222476 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1410/2817] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:01:59.226724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6bdcd-46e8-450a-a4a2-3b08d8b7b37d None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:59.236115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6bdcd-46e8-450a-a4a2-3b08d8b7b37d None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:59.241763 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:59.242445 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.242724 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.242987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.243662 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:59.245547 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.274458 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1408/2818] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:01:59 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:59.278756 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:59.288655 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab809-de13-4d07-9458-904d6727200b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:59.348588 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:59.349256 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.349656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.349994 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.351113 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:59.354104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.378467 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1411/2819] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:01:59 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:01:59.384207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:59.395140 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375671d-66bc-4666-8960-dbb2aff4fedd admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:59.400491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:59.401096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.401375 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.401649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.402420 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:59.404159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.414745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1409/2820] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:59.418821 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:59.429197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d92df4-d4d6-4061-aa3a-95b97cbb6723 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:59.434675 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5af75-92db-4385-8235-b8de10973d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:59.435327 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5af75-92db-4385-8235-b8de10973d40 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.435743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5af75-92db-4385-8235-b8de10973d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.436027 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5af75-92db-4385-8235-b8de10973d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.436811 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5af75-92db-4385-8235-b8de10973d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:59.438448 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5af75-92db-4385-8235-b8de10973d40 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.448309 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1412/2821] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:01:59.452360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:59.463051 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f834014-61aa-4bee-ae85-231a3be698c3 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:59.468198 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:59.469074 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.469353 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.469619 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] PATH_INFO: `/v3/projects/2eb8beec0d1d45b7828b52911c380750/users/e271465e497f41cfb1553ac5ea19ec85/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.484185 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb8beec0d1d45b7828b52911c380750, user_id=e271465e497f41cfb1553ac5ea19ec85, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:59.486845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.503063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1410/2822] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:01:59 2022] PUT /identity/v3/projects/2eb8beec0d1d45b7828b52911c380750/users/e271465e497f41cfb1553ac5ea19ec85/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:01:59.571752 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182caba3-01eb-4b3c-9a8c-a2e7ebc445f4 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.572177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182caba3-01eb-4b3c-9a8c-a2e7ebc445f4 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.572697 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182caba3-01eb-4b3c-9a8c-a2e7ebc445f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.602191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-182caba3-01eb-4b3c-9a8c-a2e7ebc445f4 None None] MFA Rules not processed for user `e271465e497f41cfb1553ac5ea19ec85`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:01:59.603437 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-182caba3-01eb-4b3c-9a8c-a2e7ebc445f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:59.667509 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1413/2823] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:01:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:01:59.679554 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:01:59.681464 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:01:59.738647 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283b8e-6e38-4dc1-914f-3b53b1ca0a9f admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:01:59.744063 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:01:59.744715 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:01:59.744995 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:01:59.745302 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:01:59.754025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:01:59.755517 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:01:59.764414 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1411/2824] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:01:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:02:05.730288 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde04e-7bb0-4104-819b-81abd1d5801c None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:05.730785 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde04e-7bb0-4104-819b-81abd1d5801c None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:05.730889 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde04e-7bb0-4104-819b-81abd1d5801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:05.749169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-42fde04e-7bb0-4104-819b-81abd1d5801c None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:05.750417 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-42fde04e-7bb0-4104-819b-81abd1d5801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:05.807887 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1414/2825] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:05.856841 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:05.858393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:05.928882 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2218-3c50-484a-9918-d35aff2c2029 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:05.934843 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:05.935481 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:05.935767 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:05.936043 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:05.944494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:05.946096 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:05.954508 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1412/2826] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 15:02:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:02:06.479245 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c054bc-49c1-4b24-ad93-d66d384e861a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:06.479547 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c054bc-49c1-4b24-ad93-d66d384e861a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:06.479822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c054bc-49c1-4b24-ad93-d66d384e861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:06.498985 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-52c054bc-49c1-4b24-ad93-d66d384e861a None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:06.500190 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-52c054bc-49c1-4b24-ad93-d66d384e861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:06.507923 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1415/2827] 10.222.0.43 () {58 vars in 967 bytes} [Thu Mar 24 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:06.520904 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:06.531908 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a997b-7270-43cf-a5f6-166917103467 service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:06.537699 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:06.538365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:06.538649 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:06.538926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:06.547161 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:06.548742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:06.556869 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1413/2828] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 15:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:02:06.776853 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073f48d-3dd2-40a3-96ed-758b7999dfc0 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:06.777407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073f48d-3dd2-40a3-96ed-758b7999dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:06.777510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073f48d-3dd2-40a3-96ed-758b7999dfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:06.795340 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-6073f48d-3dd2-40a3-96ed-758b7999dfc0 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:06.796510 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-6073f48d-3dd2-40a3-96ed-758b7999dfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:06.804255 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1416/2829] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:06.816737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:06.828081 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ce4d-44c1-44c8-9c8c-077c6800fd8b service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:06.834206 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:06.834847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:06.835115 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:06.835395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:06.843656 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:06.845252 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:06.853280 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1414/2830] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 15:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:02:07.177407 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:07.177690 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:07.177959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:07.196582 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:07.197760 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:07.206597 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1417/2831] 10.222.0.43 () {58 vars in 967 bytes} [Thu Mar 24 15:02:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:07.219021 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:07.230394 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1219d7-cdfa-49f3-846e-c5c85114934a service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:07.236827 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9f613-4c87-4ff3-8d06-3a8a8e9faa04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:07.237467 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9f613-4c87-4ff3-8d06-3a8a8e9faa04 service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:07.237749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9f613-4c87-4ff3-8d06-3a8a8e9faa04 service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:07.238019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9f613-4c87-4ff3-8d06-3a8a8e9faa04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:07.246593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9f613-4c87-4ff3-8d06-3a8a8e9faa04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:07.248191 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9f613-4c87-4ff3-8d06-3a8a8e9faa04 service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:07.256421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1415/2832] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 15:02:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:02:11.457911 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:11.464147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:11.530906 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e880e3-b6a8-4bcb-9140-84891c1a2f59 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:11.535764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:11.536591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:11.538215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:11.538215 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] PATH_INFO: `/v3/users/df4e425ec5564f27a0825867e7543366` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:11.538904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4e425ec5564f27a0825867e7543366)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:11.540986 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:11.595917 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4e425ec5564f27a0825867e7543366'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:11.606644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4e425ec5564f27a0825867e7543366'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:11.607660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4e425ec5564f27a0825867e7543366'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:11.608160 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4e425ec5564f27a0825867e7543366'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:11.621191 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4e425ec5564f27a0825867e7543366'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:11.637813 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1418/2833] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:02:11 2022] DELETE /identity/v3/users/df4e425ec5564f27a0825867e7543366 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:11.642888 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:11.643278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:11.643278 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:11.667497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:11.669623 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:11.757091 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1416/2834] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:11.773147 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:11.774726 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:11.839723 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa5a9-c179-4291-a32d-63290a7c9319 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:11.844101 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee135c4-e3f5-4e73-8b9d-62fb9fbff0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:11.845051 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee135c4-e3f5-4e73-8b9d-62fb9fbff0ef service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:11.845743 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee135c4-e3f5-4e73-8b9d-62fb9fbff0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:11.846268 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee135c4-e3f5-4e73-8b9d-62fb9fbff0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:11.861806 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee135c4-e3f5-4e73-8b9d-62fb9fbff0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:11.862707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee135c4-e3f5-4e73-8b9d-62fb9fbff0ef service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:11.873472 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1419/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:02:12.225728 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.228494 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:12.245657 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc533d-1104-4286-b5ea-f0e408403877 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.255434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.256312 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.257318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.258009 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] PATH_INFO: `/v3/projects/24a82f9d03544309b0db5474390e9669` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.260351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a82f9d03544309b0db5474390e9669)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.262845 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.314990 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a82f9d03544309b0db5474390e9669', 'request_id': 'req-cc9123a9-07fa-4dd5-8744-bee611e81cf8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:12.324894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a82f9d03544309b0db5474390e9669', 'request_id': 'req-cc9123a9-07fa-4dd5-8744-bee611e81cf8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:12.332491 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a82f9d03544309b0db5474390e9669', 'request_id': 'req-cc9123a9-07fa-4dd5-8744-bee611e81cf8'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:12.347284 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] The token cache is being invalidate because project 24a82f9d03544309b0db5474390e9669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:02:12.347569 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:12.348289 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cc9123a9-07fa-4dd5-8744-bee611e81cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:12.349936 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1417/2836] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:02:12 2022] DELETE /identity/v3/projects/24a82f9d03544309b0db5474390e9669 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:12.355210 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478393e-4d4d-4645-9c02-4f354e0f3cf2 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.355550 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478393e-4d4d-4645-9c02-4f354e0f3cf2 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.356057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478393e-4d4d-4645-9c02-4f354e0f3cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.374175 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-1478393e-4d4d-4645-9c02-4f354e0f3cf2 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:12.375440 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1478393e-4d4d-4645-9c02-4f354e0f3cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:12.442800 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1420/2837] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:12.451007 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15db6-00dd-428f-a124-55d60fe30b29 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.451365 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15db6-00dd-428f-a124-55d60fe30b29 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.451981 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d15db6-00dd-428f-a124-55d60fe30b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.471341 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-69d15db6-00dd-428f-a124-55d60fe30b29 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:12.472549 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-69d15db6-00dd-428f-a124-55d60fe30b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:12.480670 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1418/2838] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 24 15:02:12.484960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478393e-4d4d-4645-9c02-4f354e0f3cf2 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.494774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478393e-4d4d-4645-9c02-4f354e0f3cf2 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.499591 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.500257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.500546 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.500822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.501551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 24 15:02:12.501862 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.503513 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.515769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1421/2839] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Mar 24 15:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 24 15:02:12.520237 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d15db6-00dd-428f-a124-55d60fe30b29 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.529996 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d15db6-00dd-428f-a124-55d60fe30b29 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.534716 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.535386 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.535750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.536036 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] PATH_INFO: `/v3/projects` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.536777 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.538782 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.565866 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1419/2840] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:02:12 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:02:12.570373 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.581257 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526755-087d-4abf-b69d-f021f6cec3f7 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.647142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.647881 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.648169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.648447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] PATH_INFO: `/v3/users` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.649181 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.651296 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.680443 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1422/2841] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:02:12 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 24 15:02:12.681717 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.692530 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880c379-be76-4d63-a9ce-2d0e0aa8a59c admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.697335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.698016 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.698349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.698622 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] PATH_INFO: `/v3/roles` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.699351 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.700984 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.712640 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1420/2842] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:02:12.716623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.726904 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401543-7a3d-4aaa-a70c-75beb73177ef admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.731388 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997d888-558f-48c0-a6cf-854a62019e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.732059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d888-558f-48c0-a6cf-854a62019e52 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.732456 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d888-558f-48c0-a6cf-854a62019e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.732624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d888-558f-48c0-a6cf-854a62019e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.733551 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997d888-558f-48c0-a6cf-854a62019e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.735219 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997d888-558f-48c0-a6cf-854a62019e52 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.746459 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1423/2843] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:02:12.750750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.760931 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b3ce0-f915-4749-8cd3-3b76169dd54e admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.765606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.766571 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.766891 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.767173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] PATH_INFO: `/v3/projects/0690505632574f6a822209142c0a017b/users/774b9e78740249508ab5499cf38c11b5/roles/610442154bc84cae961360db5432b95b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.782768 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0690505632574f6a822209142c0a017b, user_id=774b9e78740249508ab5499cf38c11b5, role_id=610442154bc84cae961360db5432b95b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.785527 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.803758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1421/2844] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:02:12 2022] PUT /identity/v3/projects/0690505632574f6a822209142c0a017b/users/774b9e78740249508ab5499cf38c11b5/roles/610442154bc84cae961360db5432b95b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:12.809226 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.809516 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.809833 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.829747 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:12.832276 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:12.902396 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1424/2845] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:12.910938 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:12.912754 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:12.969486 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4a0e-fa70-417d-831d-2131c30a9738 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:12.973776 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:12.974505 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:12.974787 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:12.975052 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:12.984395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:12.985750 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:12.995247 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1422/2846] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:02:15.772227 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:15.774344 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:15.792926 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc4985-2e0d-42ad-b6fe-87d9471535c8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:15.796680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e44618-ffe8-49ba-9e38-91f4f3a60f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:15.797350 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e44618-ffe8-49ba-9e38-91f4f3a60f14 service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:15.797634 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e44618-ffe8-49ba-9e38-91f4f3a60f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:15.797960 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e44618-ffe8-49ba-9e38-91f4f3a60f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:15.801297 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-94e44618-ffe8-49ba-9e38-91f4f3a60f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:15.825825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e44618-ffe8-49ba-9e38-91f4f3a60f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:15.828978 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e44618-ffe8-49ba-9e38-91f4f3a60f14 service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:15.859090 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1425/2847] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:02:16.014274 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:16.016519 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:16.038870 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b4fb-3620-4e1e-986b-d1f06f490db2 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:16.044381 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:16.047084 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:16.047497 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:16.047873 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] PATH_INFO: `/v3/users/e271465e497f41cfb1553ac5ea19ec85` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:16.049270 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e271465e497f41cfb1553ac5ea19ec85)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:16.051409 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:16.130867 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e271465e497f41cfb1553ac5ea19ec85'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:16.150426 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e271465e497f41cfb1553ac5ea19ec85'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:16.164000 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e271465e497f41cfb1553ac5ea19ec85'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:16.180493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e271465e497f41cfb1553ac5ea19ec85'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:16.184809 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e271465e497f41cfb1553ac5ea19ec85'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:16.195325 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1423/2848] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:02:16 2022] DELETE /identity/v3/users/e271465e497f41cfb1553ac5ea19ec85 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:16.199952 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:16.200353 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:16.200725 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:16.229444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] MFA Rules not processed for user `bdaa46363cd34630bc53ea00cbbbe37d`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:16.232169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:16.340769 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1426/2849] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:16.351044 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:16.353027 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:16.450614 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7903378-b24f-46b8-840f-4b6200400c37 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:16.459894 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb4a4a-0dd3-4332-8359-b89d35c94335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:16.460628 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4a4a-0dd3-4332-8359-b89d35c94335 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:16.460909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4a4a-0dd3-4332-8359-b89d35c94335 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:16.461184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4a4a-0dd3-4332-8359-b89d35c94335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:16.477680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb4a4a-0dd3-4332-8359-b89d35c94335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:16.480283 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb4a4a-0dd3-4332-8359-b89d35c94335 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:16.495403 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1424/2850] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:02:17.088538 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:17.090623 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:17.104701 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56476ae-42fa-486b-9f4f-100fff7bba55 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:17.111600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:17.112809 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:17.113410 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:17.113918 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] PATH_INFO: `/v3/projects/2eb8beec0d1d45b7828b52911c380750` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:17.115552 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb8beec0d1d45b7828b52911c380750)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:17.118074 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:17.207324 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb8beec0d1d45b7828b52911c380750', 'request_id': 'req-1e69f494-464c-4bff-8a14-65e31634dea0'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:17.221603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb8beec0d1d45b7828b52911c380750', 'request_id': 'req-1e69f494-464c-4bff-8a14-65e31634dea0'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:17.231676 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb8beec0d1d45b7828b52911c380750', 'request_id': 'req-1e69f494-464c-4bff-8a14-65e31634dea0'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:17.248504 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] The token cache is being invalidate because project 2eb8beec0d1d45b7828b52911c380750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:02:17.249059 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:17.249714 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:17.252535 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1427/2851] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:02:17 2022] DELETE /identity/v3/projects/2eb8beec0d1d45b7828b52911c380750 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:17.708732 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1f2b-c9ae-4ac5-8359-5dc8654e1486 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:17.709756 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1f2b-c9ae-4ac5-8359-5dc8654e1486 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:17.710337 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1f2b-c9ae-4ac5-8359-5dc8654e1486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:17.750173 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-830e1f2b-c9ae-4ac5-8359-5dc8654e1486 None None] MFA Rules not processed for user `774b9e78740249508ab5499cf38c11b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:17.751667 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-830e1f2b-c9ae-4ac5-8359-5dc8654e1486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:17.818944 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1425/2852] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:17.823420 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:17.825038 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:17.929974 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69f494-464c-4bff-8a14-65e31634dea0 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:17.934761 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:17.935483 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:17.935764 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:17.936036 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:17.936737 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:17.938731 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:17.970155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1428/2853] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Mar 24 15:02:17 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:02:17.973926 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e1f2b-c9ae-4ac5-8359-5dc8654e1486 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:17.989524 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e1f2b-c9ae-4ac5-8359-5dc8654e1486 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:18.057092 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:18.057948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:18.058421 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:18.058749 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:18.059502 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:18.061650 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:18.091200 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1426/2854] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Mar 24 15:02:17 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 24 15:02:18.091959 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:18.104735 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106582a6-a799-4240-811f-e79a30224d22 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:18.113013 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:18.113778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:18.114142 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:18.114428 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:18.115177 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:18.116899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:18.131023 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1429/2855] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 24 15:02:18.135183 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:18.152758 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cd7f0-1c6a-411a-9ae7-717e1337f5d0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:18.160042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:18.161174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:18.162032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:18.162032 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] PATH_INFO: `/v3/projects/84da13d9ed8d4771a96d17b6de71bfdd/users/826191ccc7604e5a9ecf11cad7a968cb/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:18.183369 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84da13d9ed8d4771a96d17b6de71bfdd, user_id=826191ccc7604e5a9ecf11cad7a968cb, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:18.186909 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:18.209626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1427/2856] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:02:18 2022] PUT /identity/v3/projects/84da13d9ed8d4771a96d17b6de71bfdd/users/826191ccc7604e5a9ecf11cad7a968cb/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:18.213439 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:18.225736 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb2bc5-f95b-49a2-bfc9-b9effbcafd99 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:18.304742 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc046f9-66b8-47be-adea-35056ccc3ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:18.305612 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc046f9-66b8-47be-adea-35056ccc3ecf admin admin] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:18.306394 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc046f9-66b8-47be-adea-35056ccc3ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:18.306808 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc046f9-66b8-47be-adea-35056ccc3ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:18.308262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc046f9-66b8-47be-adea-35056ccc3ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:18.310763 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc046f9-66b8-47be-adea-35056ccc3ecf admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:18.322946 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1430/2857] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Mar 24 15:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 24 15:02:18.326828 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:18.338918 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f0d2-88eb-4420-873a-35407f3e5718 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:18.344080 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:18.345003 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:18.345354 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:18.345634 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] PATH_INFO: `/v3/projects/84da13d9ed8d4771a96d17b6de71bfdd/users/826191ccc7604e5a9ecf11cad7a968cb/roles/970223ac1f3448ae9c023d0314fcbbbd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:18.348847 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84da13d9ed8d4771a96d17b6de71bfdd, user_id=826191ccc7604e5a9ecf11cad7a968cb, role_id=970223ac1f3448ae9c023d0314fcbbbd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:18.351739 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:18.378424 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1428/2858] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Mar 24 15:02:18 2022] PUT /identity/v3/projects/84da13d9ed8d4771a96d17b6de71bfdd/users/826191ccc7604e5a9ecf11cad7a968cb/roles/970223ac1f3448ae9c023d0314fcbbbd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:23.905991 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f57a-7fe1-4e5e-9d3b-46da099b334a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:23.906503 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f57a-7fe1-4e5e-9d3b-46da099b334a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:23.906624 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f57a-7fe1-4e5e-9d3b-46da099b334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:23.938680 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-d0b3f57a-7fe1-4e5e-9d3b-46da099b334a None None] MFA Rules not processed for user `826191ccc7604e5a9ecf11cad7a968cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:23.939916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-d0b3f57a-7fe1-4e5e-9d3b-46da099b334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:24.047729 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1431/2859] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:24.061295 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:24.063917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:24.152633 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8094c-0ed4-453a-a6f2-625349849f40 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:24.159019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6a3dbc0cbe4acc81a8691fc85c7352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:24.159710 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:24.160389 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:24.160741 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:24.252008 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:24.253781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:24.266168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1429/2860] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:02:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:02:24.418639 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:24.419253 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:24.419686 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:24.438607 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:24.440000 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:24.538637 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1432/2861] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 15:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:24.556727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:24.558680 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:24.719570 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b031-f5f8-4403-902e-a5230dd1d359 service glance] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:24.725058 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:24.725737 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:24.726019 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:24.726328 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:24.736646 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:24.738700 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:24.750677 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1430/2862] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 15:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:02:25.840933 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:25.842416 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:25.949541 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a2f22-0564-4e09-a8e7-9f2edc9c283a None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:25.955002 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:25.956104 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:25.956386 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:25.956658 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] PATH_INFO: `/v3/users/676ff129731e4de7ad16b64d52dce9ed` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:25.957945 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=676ff129731e4de7ad16b64d52dce9ed)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:25.959915 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:26.034129 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676ff129731e4de7ad16b64d52dce9ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.042888 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676ff129731e4de7ad16b64d52dce9ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.043916 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676ff129731e4de7ad16b64d52dce9ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.044685 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676ff129731e4de7ad16b64d52dce9ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.067011 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676ff129731e4de7ad16b64d52dce9ed'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.086693 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1433/2863] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:02:25 2022] DELETE /identity/v3/users/676ff129731e4de7ad16b64d52dce9ed => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:26.334822 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:26.347699 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e898ae3-b242-492e-80cc-1e83b57002e9 service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:26.496434 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:26.497495 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:26.497907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:26.498276 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] PATH_INFO: `/v3/projects/064f289f92414a78b832c412131fc63a` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:26.500142 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064f289f92414a78b832c412131fc63a)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:26.502748 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:26.578384 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064f289f92414a78b832c412131fc63a', 'request_id': 'req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.588922 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064f289f92414a78b832c412131fc63a', 'request_id': 'req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.601599 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064f289f92414a78b832c412131fc63a', 'request_id': 'req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.615339 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] The token cache is being invalidate because project 064f289f92414a78b832c412131fc63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:02:26.615626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.616452 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.621584 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1431/2864] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:02:26 2022] DELETE /identity/v3/projects/064f289f92414a78b832c412131fc63a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:26.622876 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:26.624533 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:26.648656 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d18d0-837b-43a1-b6a5-935a37b0f1c0 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:26.740899 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:26.741964 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:26.742924 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:26.743209 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] PATH_INFO: `/v3/users/080ad9bb44024051a66e2887c6c3a8dd` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:26.744529 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080ad9bb44024051a66e2887c6c3a8dd)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:26.746689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:26.841399 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080ad9bb44024051a66e2887c6c3a8dd'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.852838 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080ad9bb44024051a66e2887c6c3a8dd'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.853865 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080ad9bb44024051a66e2887c6c3a8dd'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.854854 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080ad9bb44024051a66e2887c6c3a8dd'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.868770 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-36e53c71-01ab-4dc7-8e70-5854315e1ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080ad9bb44024051a66e2887c6c3a8dd'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:26.898774 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1434/2865] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:02:26 2022] DELETE /identity/v3/users/080ad9bb44024051a66e2887c6c3a8dd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:27.094001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:27.095725 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:27.132597 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70f63-fa9b-4878-8eb3-4cbd9861e8b0 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:27.233305 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:27.234581 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:27.235020 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:27.235819 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] PATH_INFO: `/v3/projects/f166c33786ea437b9c5b41459626dcc9` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:27.237214 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f166c33786ea437b9c5b41459626dcc9)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:27.239529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:27.380625 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f166c33786ea437b9c5b41459626dcc9', 'request_id': 'req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:27.397812 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f166c33786ea437b9c5b41459626dcc9', 'request_id': 'req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:27.418489 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f166c33786ea437b9c5b41459626dcc9', 'request_id': 'req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:27.487203 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] The token cache is being invalidate because project f166c33786ea437b9c5b41459626dcc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:02:27.487727 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:27.498600 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-ed41e4f1-7b2b-4e59-ab01-67fdbe7d5e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:02:27.500529 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1432/2866] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:02:27 2022] DELETE /identity/v3/projects/f166c33786ea437b9c5b41459626dcc9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:02:34.412660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:34.413661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:34.413661 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:34.440970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] MFA Rules not processed for user `774b9e78740249508ab5499cf38c11b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:34.442660 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:34.500302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1435/2867] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:36.350745 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] REQUEST_METHOD: `POST` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:36.351246 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:36.351360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:36.369887 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.auth.core [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86182) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:36.371146 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:36.425473 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1433/2868] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Mar 24 15:02:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:02:36.439382 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:36.441052 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:36.508967 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674ffe6-5606-41a8-b021-c52f1d8a6b05 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:36.514228 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245f458-f9a7-42f0-97bc-299190322271 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:36.514873 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f458-f9a7-42f0-97bc-299190322271 service swift] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:36.515155 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f458-f9a7-42f0-97bc-299190322271 service swift] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:36.515433 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f458-f9a7-42f0-97bc-299190322271 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:36.523646 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245f458-f9a7-42f0-97bc-299190322271 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:36.525211 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245f458-f9a7-42f0-97bc-299190322271 service swift] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:36.533625 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1436/2869] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 15:02:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:02:44.427184 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:02:44.429001 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:44.497919 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44def1-b1a1-4a67-b802-880efde58645 None None] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:02:44.501586 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c290be79dec4fe8b10bc04e691c00b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:02:44.502294 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:44.502606 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:44.502879 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:44.504713 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:44.563240 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:02:44.565395 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:02:44.574889 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1434/2870] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:02:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 24 15:02:51.508173 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722feaab-5b17-4b74-ad58-60bf52e2ec16 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:02:51.508722 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722feaab-5b17-4b74-ad58-60bf52e2ec16 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:02:51.508825 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722feaab-5b17-4b74-ad58-60bf52e2ec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:02:51.527200 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-722feaab-5b17-4b74-ad58-60bf52e2ec16 None None] MFA Rules not processed for user `6b9b3d707b264422aa36e0d86757ca2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:02:51.528592 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-722feaab-5b17-4b74-ad58-60bf52e2ec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:02:51.536444 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1437/2871] 10.222.0.43 () {58 vars in 957 bytes} [Thu Mar 24 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:03:05.890630 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:03:05.892318 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:03:05.951168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a3ecd-2660-435a-a941-0da3250a90f2 service cinder] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:03:05.955983 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:03:05.956660 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:03:05.956937 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:03:05.957208 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:03:05.959227 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:03:06.019577 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:03:06.021076 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:03:06.032100 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1435/2872] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:03:32.528156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722feaab-5b17-4b74-ad58-60bf52e2ec16 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:03:32.538302 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722feaab-5b17-4b74-ad58-60bf52e2ec16 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:03:32.541932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:03:32.542603 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:03:32.542884 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:03:32.543159 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:03:32.544944 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:03:32.613678 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:03:32.615156 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:03:32.626115 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1438/2873] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:03:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:03:33.818393 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:03:33.819864 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:03:33.831962 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e04c0a-28d4-4dcd-82ec-a1cc9a8f6071 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:03:33.836168 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:03:33.836789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:03:33.837093 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:03:33.837363 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:03:33.839192 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:03:33.853209 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:03:33.854917 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:03:33.866398 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1436/2874] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:03:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:04:17.586122 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:17.587606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:17.603971 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aca00-4f0b-442b-a275-ab92bb6961da service neutron] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:17.610778 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeec987-029c-4568-a686-a5e02b03ba83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:17.611460 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeec987-029c-4568-a686-a5e02b03ba83 service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:17.611738 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeec987-029c-4568-a686-a5e02b03ba83 service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:17.612014 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeec987-029c-4568-a686-a5e02b03ba83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:17.613837 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-5aeec987-029c-4568-a686-a5e02b03ba83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:17.626883 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeec987-029c-4568-a686-a5e02b03ba83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:17.628473 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeec987-029c-4568-a686-a5e02b03ba83 service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:17.658611 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1439/2875] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:04:17.757175 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:17.770174 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793019d7-4860-45a1-b486-6d28c5c897b7 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:17.781447 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:17.784159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:17.785532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:17.786912 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:17.791069 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:17.818576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:17.820042 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:17.830795 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1437/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:04:25.671621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] REQUEST_METHOD: `POST` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:25.672089 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:25.672187 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:25.690116 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.auth.core [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] MFA Rules not processed for user `ac6e1bff8c1f44c38b86d3ebda419784`. Rule list: `[]` (Enabled: `True`). {{(pid=86181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 24 15:04:25.691316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:25.698936 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1440/2877] 10.222.0.43 () {58 vars in 967 bytes} [Thu Mar 24 15:04:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 24 15:04:25.740698 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:25.756450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba49cf4-2840-438c-814b-1abc3552bbe6 service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:25.762666 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58d77195060b4aeb8a9bfcef2dd147fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:25.763306 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:25.763587 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:25.763859 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:25.772493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:25.774095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:25.782593 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1438/2878] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Mar 24 15:04:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 24 15:04:32.500635 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:32.502378 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:32.574404 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b3c03-a638-4a52-a041-ded89e3df9a8 None None] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:32.579286 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:32.580169 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:32.580447 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:32.580708 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] PATH_INFO: `/v3/users/774b9e78740249508ab5499cf38c11b5` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:32.581902 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] RBAC: Authorizing `identity:delete_user(user_id=774b9e78740249508ab5499cf38c11b5)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:32.583845 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:32.630644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774b9e78740249508ab5499cf38c11b5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:32.637385 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774b9e78740249508ab5499cf38c11b5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:32.638056 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774b9e78740249508ab5499cf38c11b5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:32.638720 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774b9e78740249508ab5499cf38c11b5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:32.657781 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774b9e78740249508ab5499cf38c11b5'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:32.675091 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1441/2879] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:04:32 2022] DELETE /identity/v3/users/774b9e78740249508ab5499cf38c11b5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:04:32.857697 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:32.870513 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d052cd-b4ac-47f9-b16a-64d01ba5e655 service swift] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:32.931418 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:32.932279 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:32.932561 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:32.932837 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] PATH_INFO: `/v3/projects/0690505632574f6a822209142c0a017b` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:32.934030 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0690505632574f6a822209142c0a017b)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:32.936006 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:32.984321 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0690505632574f6a822209142c0a017b', 'request_id': 'req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:32.993335 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0690505632574f6a822209142c0a017b', 'request_id': 'req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:32.999159 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0690505632574f6a822209142c0a017b', 'request_id': 'req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.010933 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] The token cache is being invalidate because project 0690505632574f6a822209142c0a017b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:04:33.011212 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.012038 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.013740 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1439/2880] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:04:32 2022] DELETE /identity/v3/projects/0690505632574f6a822209142c0a017b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:04:33.017934 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:33.019599 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:33.033801 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7256812-71bb-42c5-bef2-886ea3b3481b admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:33.087244 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:33.088108 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:33.088395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:33.088674 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] PATH_INFO: `/v3/users/826191ccc7604e5a9ecf11cad7a968cb` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:33.089886 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=826191ccc7604e5a9ecf11cad7a968cb)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:33.091861 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:33.141326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826191ccc7604e5a9ecf11cad7a968cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.148480 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826191ccc7604e5a9ecf11cad7a968cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.149130 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826191ccc7604e5a9ecf11cad7a968cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.149749 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826191ccc7604e5a9ecf11cad7a968cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.161644 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826191ccc7604e5a9ecf11cad7a968cb'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.177395 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1442/2881] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:04:33 2022] DELETE /identity/v3/users/826191ccc7604e5a9ecf11cad7a968cb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:04:33.358629 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:33.360195 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:33.373221 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bb6ca-9185-49a6-ad77-bee3da0f2aa2 admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:33.429742 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:33.430674 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:33.430979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:33.431243 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] PATH_INFO: `/v3/projects/84da13d9ed8d4771a96d17b6de71bfdd` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:33.432537 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84da13d9ed8d4771a96d17b6de71bfdd)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:33.434542 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:33.485863 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84da13d9ed8d4771a96d17b6de71bfdd', 'request_id': 'req-7b36033c-dc9d-4faf-b898-dde081e32a2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.496360 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84da13d9ed8d4771a96d17b6de71bfdd', 'request_id': 'req-7b36033c-dc9d-4faf-b898-dde081e32a2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.503720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84da13d9ed8d4771a96d17b6de71bfdd', 'request_id': 'req-7b36033c-dc9d-4faf-b898-dde081e32a2d'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.516025 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] The token cache is being invalidate because project 84da13d9ed8d4771a96d17b6de71bfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:04:33.516338 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.517095 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:33.518789 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1440/2882] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:04:33 2022] DELETE /identity/v3/projects/84da13d9ed8d4771a96d17b6de71bfdd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:04:39.960042 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:39.961600 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:40.034913 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66f1a7-67e9-4174-809a-e18721ecbb48 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:40.108065 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cc15d4ea22b441ab70b958fba26a07f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:40.108975 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:40.109453 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:40.109921 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:40.112308 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:40.125203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:40.126932 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:40.139908 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1443/2883] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:04:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:04:52.668532 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:52.670060 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:52.728781 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36033c-dc9d-4faf-b898-dde081e32a2d admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:52.732948 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750a6a7b35204c47ac16a584e7e71713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:52.733626 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] REQUEST_METHOD: `GET` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:52.733929 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:52.734236 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:52.736355 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:52.804987 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:52.806477 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:52.816493 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1441/2884] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 24 15:04:59.056557 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:59.058025 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:59.074753 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faf5ce-eef1-45f7-80ab-f969b196aa4c service nova] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:59.080614 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:59.081707 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:59.081990 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:59.082384 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] PATH_INFO: `/v3/users/6b9b3d707b264422aa36e0d86757ca2e` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:59.083506 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9b3d707b264422aa36e0d86757ca2e)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:59.085561 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:59.135758 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9b3d707b264422aa36e0d86757ca2e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.143622 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9b3d707b264422aa36e0d86757ca2e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.144429 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9b3d707b264422aa36e0d86757ca2e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.145057 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9b3d707b264422aa36e0d86757ca2e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.159150 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9b3d707b264422aa36e0d86757ca2e'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.173326 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1444/2885] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:04:59 2022] DELETE /identity/v3/users/6b9b3d707b264422aa36e0d86757ca2e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:04:59.344396 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:59.354952 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1986697-86a5-4eb2-a35c-393498085fdd service neutron] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:59.434563 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:59.435357 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:59.435639 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:59.435907 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] PATH_INFO: `/v3/projects/ba28e6d467154998b4eae495425f12aa` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:59.437245 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba28e6d467154998b4eae495425f12aa)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:59.439207 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:59.490262 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba28e6d467154998b4eae495425f12aa', 'request_id': 'req-79d45f2e-194b-4f2d-994b-e09a518446cf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.499178 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba28e6d467154998b4eae495425f12aa', 'request_id': 'req-79d45f2e-194b-4f2d-994b-e09a518446cf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.504915 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba28e6d467154998b4eae495425f12aa', 'request_id': 'req-79d45f2e-194b-4f2d-994b-e09a518446cf'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.515783 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] The token cache is being invalidate because project ba28e6d467154998b4eae495425f12aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:04:59.516064 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.516708 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.518326 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1442/2886] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:04:59 2022] DELETE /identity/v3/projects/ba28e6d467154998b4eae495425f12aa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:04:59.522534 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:59.524054 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:59.537240 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af776e7a-1eac-4d78-bc7d-0db1578d4149 admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:59.594822 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:59.595621 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:59.595903 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:59.596203 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] PATH_INFO: `/v3/users/22f0eea35baa47738fb76bb0aa4e805b` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:59.597511 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f0eea35baa47738fb76bb0aa4e805b)` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:59.599606 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:59.649491 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f0eea35baa47738fb76bb0aa4e805b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.656342 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f0eea35baa47738fb76bb0aa4e805b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.657080 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f0eea35baa47738fb76bb0aa4e805b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.657799 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f0eea35baa47738fb76bb0aa4e805b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.669431 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.notifications [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f0eea35baa47738fb76bb0aa4e805b'} {{(pid=86181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.683262 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1445/2887] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Mar 24 15:04:59 2022] DELETE /identity/v3/users/22f0eea35baa47738fb76bb0aa4e805b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:04:59.865520 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Authenticating user token {{(pid=86182) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:04:59.867047 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.fernet_utils [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86182) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:04:59.880202 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45f2e-194b-4f2d-994b-e09a518446cf admin admin] Validating token access rules against request {{(pid=86182) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:04:59.937681 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdaa46363cd34630bc53ea00cbbbe37d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c10c7d278dd470682481e8cf01ddafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86182) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:04:59.938576 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:04:59.938860 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:04:59.939133 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] PATH_INFO: `/v3/projects/59b13974a2f047b695c7a0b5d56a5348` {{(pid=86182) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:04:59.940313 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b13974a2f047b695c7a0b5d56a5348)` {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:04:59.942349 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] RBAC: Authorization granted {{(pid=86182) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:04:59.987450 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b13974a2f047b695c7a0b5d56a5348', 'request_id': 'req-cdb9443d-b49e-4738-a8be-61e63dc4e087'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:04:59.996720 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b13974a2f047b695c7a0b5d56a5348', 'request_id': 'req-cdb9443d-b49e-4738-a8be-61e63dc4e087'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:05:00.004017 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b13974a2f047b695c7a0b5d56a5348', 'request_id': 'req-cdb9443d-b49e-4738-a8be-61e63dc4e087'} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:05:00.014979 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] The token cache is being invalidate because project 59b13974a2f047b695c7a0b5d56a5348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86182) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 24 15:05:00.015266 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:05:00.015883 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: DEBUG keystone.notifications [None req-cdb9443d-b49e-4738-a8be-61e63dc4e087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86182) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 24 15:05:00.017404 dv-cinder-834805-2-iscsi devstack@keystone.service[86182]: [pid: 86182|app: 0|req: 1443/2888] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Mar 24 15:04:59 2022] DELETE /identity/v3/projects/59b13974a2f047b695c7a0b5d56a5348 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 24 15:07:24.423320 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Authenticating user token {{(pid=86181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 24 15:07:24.424970 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:07:24.586316 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca936-1b78-414f-a974-ffec67739d4f admin admin] Validating token access rules against request {{(pid=86181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 24 15:07:24.651007 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06795a7-5c49-4448-8b4c-1af94e46815c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca33f2f8bb0a4631912f0ed51c6f8c87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9194779a0f34c48a228afad50493863', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 24 15:07:24.651689 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06795a7-5c49-4448-8b4c-1af94e46815c service placement] REQUEST_METHOD: `GET` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 24 15:07:24.651995 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06795a7-5c49-4448-8b4c-1af94e46815c service placement] SCRIPT_NAME: `/identity` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 24 15:07:24.652295 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06795a7-5c49-4448-8b4c-1af94e46815c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 24 15:07:24.654451 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.fernet_utils [None req-a06795a7-5c49-4448-8b4c-1af94e46815c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 24 15:07:24.666435 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06795a7-5c49-4448-8b4c-1af94e46815c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 24 15:07:24.668105 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06795a7-5c49-4448-8b4c-1af94e46815c service placement] RBAC: Authorization granted {{(pid=86181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 24 15:07:24.678197 dv-cinder-834805-2-iscsi devstack@keystone.service[86181]: [pid: 86181|app: 0|req: 1446/2889] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Mar 24 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)